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ABSTRACT 

Investigators applied the techniques of precision 
teaching (systematic arrangement of instructional cues^ the 
technology of programed learning , careful management of reinforcement 
contingencies y and continuous measurement of performance) to improve 
the academic performance of disadvantaged children who had been 
labeled mentally retarded. The program also aimed at developing an 
effective and replicable reading and math program incorporating 
principles of precision teaching and errorless learning procedures. 
The project was organized into a 2 year program with experimental and 
control group classrooms. Analysis of the wide Range Achievement Test 
results showed that mean grade gains in reading and math were 
approximately three times higher for the experimental classes than 
for the control groups. The experimental classes returned eight of 
the original 24 students to regular classes, while the control 
classes returned none out of a possible 24 students. Results were 
thought to confirm the hypothesis that a high percentage of children 
from an economically depressed area are labeled mentally retarded for 
socio-environmental reasons and that such children are capable of 
acquiring basic skills given a learning environment which maximizes 
pupil performance. Presentation procedures, academic materials, and 
evaluation and contingency management procedures were explained in 
detail. (GW) 
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INVESTIGATION OF SYSTEMATIC INSTRUCTIONAL PROCEDURES TO FACILITATE 
ACADEMIC ACHIEVEMENT IN MENTALLY RETARDED DISADVANTAGED CHILDREN 



Title of Project ; Investigation of Systematic Instructional Procedures to 
Facilitate Academic Achievement in Mentally Retarded 
Disadvantaged Children 

Project Director : Dr. Norrls G. Haring 
Project Coordinator : Laurence Maddux 
Assistant Project Director : David A. Krug 

ABSTRACT 

Purpose 

The primary objective of the project was to extend the principles of 
instruction to promote advancements in the management of educational 
problems pi;^sent^d by chi Idren classified as mentally retarded. The second 
objective .was. to. develop an effective and repli cable readrnj and math 
program, Incorporating these principles in instruction and errorless learning 
procedures to maximize pupil performance. Specifically, the investigators 
intended to meet the folldwing object ivies: 

1. To Establish and demonstrate systematic instructional 

'' procedures which facilitate efficient de\^elopment of academic 
Skills. 

2. To sequence a series of reading and math tasks in an order 
that enables the child to proceed almost >errorlessly toMi^ard 
terminal skill objectives, using materials that are practical 
for use in regular classroom instruction. 

3. To provide feedback and reinforcement for correct responses 
that facilitate efficient, accurate performance. That is: 

a. to increase the probability of the child's attending to 

the task appropriately, and 

b. to increase the likelihood that he will persist in the task. 
To develop students' basic reading skills which include visual, 
graphic, and auditory responses to: 

a. all English letters; and 

b. all common word parts as introduced in Books 1-12 of the 
programmed reading materials; 

c. all words programmed in this same sequence of books; 

d. basal readers, word lists, comprehension questions, and 
independent reading material. 

5. To develop sequentially the students' basic skills in traditional 
and new math. 

6. To increase the rates of accurate responding in reading and 
math to grade level. 

7. To determine what modifications, if any, must be made in the 
total program in order to bring e^ch child's skill to criterion 
performance. That is: ^ 



a. To determine what modifications, If any, must be made in 
the sequence of cues (Instructional material); and 



b. To determine what modifications, if any, must be made in 
the types and arrangements of reinforcement used. 

8. To place the child in the regular classroom once i.is reading 
and math skills have reached criterion performance in the 
special classroom. 

In addition, the investigators intended to follow the progress of the 
students once they returned to regular classrooms in order to: 

a. maintain the students' skill levels in mat' and reading and their 
rate of performance; 

b. provide follow-up assistance to the students and their teachers; and 

c. continue to Investigate" the conditions that can change any error 
patterns th^.t had been established or were not removed- earl ier. 

Although these follow-up objectives have not yet been accomplished, they 
proviJ<^ the basic topic and the materials for the doctoral dissertation of 
the Project's Assistant Oirectdi', David A. Krug. Mr. Krug will be 
following the progress df the experimental class students and providing 
assistance to them and their regular classroom teachers during the 1971^*1972 
school year. A copy of h\i dissertation, in which the follow**ap data are 
reported, will be sent to the Bureau of Education for the Hartdicapped. 
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Method 



The project was organized into a two-year program with experimental and 
control group classrooms. Children in the experimental classrooms received 
reading and math instruction under systematic procedures, while children 
in the control classrooms receiver programs specified by the teachers and 
substantiated through periodic observation. 

In the experimental classrooms, a multiple baseline analysis was conducted 
to determine and demonstrate that particular reinforcement variables intro- 
duced to change rates of performance were in fact the variables that changed 
performance. This single N design required that one treatment variable be 
introduced at a time. Child performance was precisely measured, recorded, 
and evaluated, and reinforcing consequences for correct responses to academic 
tasks were provided systematically. The child was observed and continuously 
measured in a precise manner before the treatment variables were introduced 
as well as during the treatment. 

Results and Discussion 

An analysis of thei V/ide Range Achievement Test pre-post results for the 
experimental and control classrooms for reading and math show the following 
mean grade gains made for the 1970-71 school year: 

^ Experimental classes t 

Reading - 'mean grade gain of 1.35 
Math - mean grade gain of 1.61 

Control classes: 

Reading - mean grade gain of 0.^5 

Math - mean grade gain of 0.^8 ' \ 

Perhaps the clearest indicator of overall improvement in academic 
behavior was the number of return- to- regular-class placements. The 
experimental classes returned eiglit of the original twenty-four students 
to regular class, while the control classes returned none out of a possible 
twenty-four. 

Conclus ions 

The original hypothesis of the project was that a high percentage of 
children from an economicol ly depressed area placed into Educable Mentally Retarded 
classes are labeled mentally retarded for socio-envi ronmental reasons, and 
that these children are capable of acquiring basic skills given a learnrhg 
environment (based on precision teaching) v/hich maximizes pupil performance. 
The project results empirically confirmed the hypothesis. 



Introduct ion 



More than half the children described as having special learning or 
behavior problems are classified as mentally retarded. Unless these 
children receive effective instruction^ they become an increased financial 
burden to society. It goes without saying that the personal damage the children 
endure as a result of ineffective education is as serious a concern 
as the financial burden. 

Research shows that children classified as mentally retarded do develop 
academic skills if the skills are specifically taught them (Kirk, 196^). 
Skill development has been most effectively taught to the mentally 
retarded child through procedures which utilized systematic instructional 
materials based on scientific principles of instruction (Frey, I96I; Haring & 
.Phillips,.l97l, in press, Oirnbrauer, Wolfi Kidder, fi' Tague,' I965) , 

The investigators of this project were influenced by research on error- 
less learning, by scientific principles of instruction, and by their I968 
summer experience with culturally disadvantaged children, to believe that a 
population of children identified as mentally retarded and living in a 
disadvantaged area could be taught reading and math skills at grade level 
or above. 

Two overall objectives were to be accomplished. The first major 
objective of the project was to extend the principles of instruction to 
promote better management of tha educational problems mentally retarded 
children present. The second objective was to develop an effective and 
replicable reading and r.iath program for mentally retarded children 
whicli would incorporate principl'^s of instruction and errorless learning 
procedures in order to maximize pupil performance. 

This report describes and provides the rationale for teacher development 
of curriculum materials, classroom organization, and measuring and charting 
of academic behaviors. Replication of the materials described and proper 
implementation of the procedures wilT enable a teacher to create a class- 
room environment in which continuous feedback and assessment of individual 
learning can bo integrated info an effective teaching routine. 

I nst ruct i ona I Procedu res 

Data Collection Procedures 

Continuous measurement enables the teacher to effectively monitor student 
performiance on a day-to*day basis, and this monitoring must be continuous if 
Individual needs are to be met. A crucial advantage of continuous measurement 
is' that' it ^fves the teacher basic information on child performance which is 
necessary to effectively change that child's instructional program. Another 
advantage is that continuous measurement enables the educator to be accountable 
for what is occurring in his classroom. In addition to promoting better instruc- 
tion, continuous data also serve as useful tools for explaining to others the 
rationale for classroom procedures. 

k 



The three tools a teacher must learn to use for taking continuous data In 
the classroom are the plan sheet, the event sheet, and the six-cycle graph. 

The plan sheet (Figure 1) Is used as a tool for the development 
of lesson or teaching plans. The Important function of the plan sheet 
is that it forces the teacher to sort out and systematically organize 
instructional procedures into specific learning processes which will be of 
most value to each individual student (Martin & Hulten, 1970). 

The event sheet is used In the classroom for the actual recording of 
collected data. An event sheet packet containing name, date, and currlcular 
programming v/as placed on each student's desk before each instructional day 
(Figures 2a and 2b). The event sheet represents some aspects of the 
child's behavior over a perloH of time, and in this project the behaviors 
generally recorded were academic correct and error responses. There are five 
sheets contained in each event sheet packet. Each event sheet packet repre- 
sents one day, each sheet of the packet represents one hour, and each line 
on the sheet represents one minute (Mingo, 1970). 

The collected data were recorded on six-cycle semi-log graph paper, 
(Figure 3) especially designed for recording defined movement cycles 
(Hulten & Kunzelmann, 1970). 

Charting Procedures and Conventions 

The essential materials for plotting the rates of observed behaviors are 
chart paper (six-cycle semi-log graph paper was used on the Tacoma project), 
a sharp pencil, a rate plotter, and a tool for making plots (a template). 
(Figure ^) 

Six-cycle semi - logar I thmic chart paper is produced by the Behavior 
Research Company, Box 3351, Kansas City, Kansas 66103. On the bottom of 
each sheet are places for listing the name of the person whose behavior is 
being charted, the name of the teacher, and the movement cycle (write letters, 
say words, etc.) which Is being charted. The vertical sequence of numerals 
on the left-hand side o''^ the page Indicates the number of movements per 
minute, the horizontal sequence across the bottom of the page represents 
successive calendar days, and across the top are listed letters (M, W, F) 
to indicate days of the week. (Figure 5) 

VJhen plotting large amounts of data, the process of dividing the move- 
ments by time Is time consuming. Much of this time can be saved by 
using the rate plotter (Figured), a transparent plastic strip which 
functions as a slide rule (Hulten & Kunzelmann, 1970). Vihen using 
the rate plotter one locates the number of movements (the dividend) on the 
graph paper, and then aligns the number of minutes (the divisor) with the 
dividend. The rate plot (quotient) Is then located on the graph paper across 
from where it says ''Plot Here" on the rate plotter. To summarize, 
the three steps for using the rate plotter are: 
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Figure 3 
Blank Six-cycle Graph Paper 
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a. Locate the cilvideriJ (the number of responses) on the graph paper. 

b. Align the divisor (an.ount of time) on the rate plotter with (a). 

c. Plot the quotient (the rate per minute) on the graph paper to 
the left of th3 ''\'* on tie rate plotter 

Both correct anj error rates of the academic behaviors measured on 
the Tacoma Project were charted. In order to distinguish between the two 
plots for the same day different symbols ware adopted to Identify corrects 
and errors differentially. Solid circles were used to represent corrects 
and solid triangles ware used to represent errors. These circles and tri- 
angles were made with the oid of a plastic templata (Figure A). 

The edge of the texp\at^. was used to indicate on the graph where phase 
changes wore made, A phcss change occurs whenever environmental conditions 
(curriculum, reinfcrccr.e'-.t, etc.) are manipulated to effect a change In 
student performance. To indicate the phase change a vertical line is drawn 
between the last day of the previous phase and the first day of the new 
phase. The horizontal portion (Figure 5) continues far enough to 
allow a brief description of the change to be written in. 

Another solid line commonly found on graphs is the horizontal Record 
P^oor line. The value of this line, when one plots a group of data points, 
is that It provides a handy reference point for determining when zero errors 
are occurring. The Record Floo'- line's function Is to indicate where the 
minlrurr rate, ccher than rero, for a olven period is located. Any 
plot b'Dlc^' tfiic line, tl. ^,r, represents .^ero rate (Figure 5). Record 
Floor Is co^r.FUt/^^: by ^IviJlng the length of the observation period Into the 
numeral 1. The. for^ul:: ]z: 

R.F. - 1 

Minjt'=>s of o!>5ervation 

Excmple: ;;i j 30-n:n'jcc period the record floor would be: 
• R.F. = J 

I R-F. = .033 

Graphing rates of r --•^ovr.- ' o.i semi-log graph paper results In many 
Record Floors being belo/ the »M" rr.cvement-per-m: nute line (Figure 5). 
In such cases rates \;h!ch a-e plotted below the *M*' movement-per-mlnute 
line are expressed as doclu'^b ond car, be misleading If read In the standard 
fashion. For instence, if r.:ovmc.its per minute Is read as ''four tenths 
of a movement per minvte," the Irforn^ation is very vague. However, if 
It Is Interpreted cs ''four n'ov^.n^ents every ten minutes,'^ then the meaning Is 
mufch clearer; it Is easier to imagine a student doing four math problems 
every ten minutes than it is to imagine him doing four-tenths of a problem 
every one mli'ute. This method of reading rates below the ^'T* movement-per- 
mlnute line is e'jnecially helpful when one reads very low rates such as 
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.05 which make little sense when read as "five hundredths of a movement 

per minute/'' When read as ''5 movements every hundred minutes,*' however, the 

meaning is quite clear. 

Teacjter Training 

Teacher train 'ng began two weeks before the school year with each teacher 
receiving a packet of materials from the Experimental Education Unit. Most ' 
of the first week was spent going over the r.ioterials dealing with the plan 
sheet, the event sheet, and graphing, with some time spent on evaluation and 
selection of probe iraterials. During the second week teachers observed 
classrooms at the Experimental Education Unit where those techniques and' 
materials are in use. Training the teachers in the use of the probes (see 
probe section) included a discussion of the rationale for the probing 
process, the presentation procedure, the data collection procedure and the 
scoring criteria. 

Classroom Schedule 

Preparation of the daily event sheets for one classroom {]1 students) 
took, on the average, approximately one hour of teacher time and was generally 
accomplished prior to, or immediately fol lowing, the students* 'dsiily instruction. 
The classroom Instructional schedule was organized 5g follows:'' 

8:30 - 9^30 - Regular classroom teacher conducted traditional business-- 
lunch count, attendance count, etc. 

9*30 - 10:00 - Each class was divided into two groups of equal size. Group 
One worked on Uistar Reading (Group Say-sounds); Group Two 
worked on Suppes Math (Wr i te-rumbt^rs) . Assignment to groups 
was determined by the student's placement in the Distar Book. 
One teacher was assigned to each group. 

10:00 - 10:30 Recess. Supervised by the sch-^ol staff in ordpr to release 

if>r6j6ct teacners fo*' the cask of calculating Distar responses 
' ' ' ' ' - • for graphing.' 

10:50 11:00 ^ The 9:30 groiips switched tasks. 

1 TrOCf'^-* 1 r:30 ' - Both groups were in Distar Reading (V/rite-letters, Say-sounds) 
- While one teacher made Wr i tc- letter contacts, ^ . 

' ' ' the other toacher took ons-minute Say-ietter, and Say-soi|nd 
'-J samples (see Appendix)., During tiiis time the students sat 
V' jp 3 circle (facing out) tc provid-i easy access for the teacher 
making Write-letter contacts (Figure 6). 



11:30 - 12:30 - Lunch. Teachers uti1i::ed the lunch period for filling out 
event sheets, checking point totals, planning .activities, 
and discussing program ciianges. ; 
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12:30 - 



1:00 - Sullivan Programmed Reading (all stude^ts) . 



1:00 - 1:30 - Distar Reading Penmanship Program. Students who had completed 
Distar A and B bo-^ks continued working in Sullivan Programmed 
Reading, 

1:30 - 2:00 - Suppes Math (all students). 
2:00 - 2:1 5 - Recess. 

2:15 - 2:45 - SRA Basic Reading Series (all students) 
2:kS - 3:00 - Clean-up and dismissal. 

Cldssroorti Arrangement 

J ' • J " n ■ 

One section of each experimental classrocn was set aside for activities the 
students had earned . That is, a student who earned, say, 5 points In math or 
reading could convert those points into 5 minutes of an activity of hU/Chpice— 
arts and crafts, games, etc. — in the "play** oi^co. The other section of the 
classroom— the academic section— was divided into two parts to allow for large- 
group and small-group instri'ction. In the lai-ge-group area, the destSte' Were placed 
in a circle with the students facing out. This arrangement facilitated teacher- 
student contact when the teacher corrected programmed materials and It tended 
to minimize student intercction. A round table was used for small-group 
instruction — Distar and SRA croups (Figure 6). 



P resentation Procec!ur'^s--Reading 

Distar Reading 

The class schedule was organized to place emphasis on reading and math. 
The Initial basic reading program for students locking letter recognition 
skills was bistar. All students lacking letter recognition skills, as 
determined by the probing orocedure, began in Distar book A with the letter 
M. The classes were divided into tv/o croups in order to facilitate the Distar 
presentation. Each group received thirty minutes of Instruction during the 
Group Say-sound period. Fach student gcve say samples for letter recogni.tion 
(Say-letters) and sound recognition (Say-sounds). Teachers recorded' correct 
and error responses cnr c so/ ^ra'o data sheet (Figure 7) t and l^er, transferred 
them to t'«e event sheet, fl.'^ ar.cint of time for eaqh s,ample varied; thus 
there Is' a "floating floor" for tiie Distar Group Say-sounds graph (Appendix). 
The students were allowed to mcvo through the material in the Distar books 
!(A, B, and C) according to their ability to moet the following criterion for 
any block of material: three consecutive days of errorless performance on 
group Say-sounds, on group Say-letters, end on individual Say-sounds. 
Following completion of Distar Book 3, students were dropped from the 
afternoon Distar rPenmanship Program and v;ere moved into the Sullivan Write- 
letters program in Books Pre-IA, lA, or 1 depending on their performance 
on the Sullivan Probes (See Probing Procedures). 
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A token reinforcement system was utilized during the Olstar Group Say- 
sounds period for the purposes of obtaining and maintaining student attention. 
The tolcens were multi-colored plastic chips, each one redeemable at the end 
of the 30-mlnute period for a point. The number of points a student earned 
was entered on the event sheet, and during certain periods of the day the 
points could be "cashed in'' for free time at the rate of 1 point for 1 minute. 

Presentation procedures and the sequence of material closely followed the 
format of the Olstar Reading Program with some minor changes made to facilitate 
continuous measurement (the use of stop watches, recording of responses) and 
utilization of the token system. The dally Olstar session began when the 
students were seated quietly at the study table. Then, using the Distar 
Instruction Book (A, B, or C) , a recording sheet (Figure 7), and stop 
watches (one for each child), the teacher provided the verbal stimulus 
indicated In the book and the children made either Individual or group resf^dnses 
as Indicated by the teacher. The toacher started the Individual student's 
stop watch at the completion of every stimulus given to him and stopped 
the watch following the student's response. The teacher then recorded the slftident's 
response In the appropriate column (correct— error) on the recording sheet 
(Figure 7). At the end of every session each student's place in the book 
was marked with a color-coded chip, and his correct and error responses Wer^ 
totaled and entered on the event sheet along with the total response tln#e 
indicated on his stop watch. . 

The Distar Group Say-sounds period was held In two groups In order to 
facilitate instruction. During the Distar Write-letter period, the class 
initially participated as one group, the students seated in a circle facing 
out (Figure 6). However, as students completed the alphabet they 
formed a new group (SRA Lab 1) at the back of the room. During the 
Distar Write- letter period all students began with the first letter 
of the Distar Sequence (M) and added one additional letter as soon 
as they mastered the ones they were working on. Mastery, as mentioned 
before, was defined as three consecutive errorless periods on three 
measurements: Individual Say-sounds, individual Say-letters, 3nd group 
Say-sounds. Following the addition of the first four letters (m, d, 
s, a) the teachers determined that most of the students could handle 
a larger addition of new letters. Subsequently, four new letters (as presented 
In the Distar Curriculum Guide) were added following the student's mastery 
of all previously presented letters. 

The Wrlte-letter work sheets were designed to show the stimulus for 
each letter on the left-hand column. Four pages were attached for student 
responses. Page one had one line of sample responses and one line of 
trace responses to be made by the student. Beginning on page two the 
students had three review pages of all previously presented letters (sfce 
Response Pdcket— Appendix) . Following mastery of the first 
four letters the students received packets to work on for the next four 
new letters. At the beginning of the period, after students were seated 
quietly, tK6 teacher provided them with Write-letter Packets. Each student 



1 

17 



wrote the responses Indicated by the teaching frame; after completing 
each line he raised his hand and the teacher corrected that line and recorded 
the correct and error responses in the corresponding time slot on the event 
sheet. The student erased all errors and repeated those responses until they 
were correct. 

In conjunction with the V/rite-lctter period, the teacher took one-ral^nute 
samples of Say-sounds and Say letters from each child using a stop watch and 
a double bank counter (Figure 8). The teacher presented a Stimulus Sheet 
containing only the letters the child was working on (see Appendix), and the 
student pointed to each letter Gnd said the name, or sound, of that stimulus 
letter. The teacher then recorded correct and error responses on the student's 
event sheet. (See Appendix, Dlstasr Say-sou.nd and Say-letter Sample plan Sheets). 

Sul I Ivan Reading 

ft • , , 

The Distar Reading Program v/as chosen as the primary tool for teaching 
the initial 'Bleps of reading because of Its emphasis on the beginning sound,^ 
and the blending* process. ' Sullivan Programmed Reading was chosen as a comr 
plement to the Distar Program because of its emphasis on sight words and student 
Involvement in the program, and because of its easy adaptability to measuring 
techniques., A student's placement in the Sullivan Reading Program was 
determined by h.i^ ^performance in Distar (completion of Book A) and on the 
Sullilvan Probes (see probes section). V/hen working in a Sullivan book the 
student was required to stop at the end of each page and raise his hand so 
that the teacher cou!d correct the completed page and record correct and 
error responses on the student's event sheet. The student then read aloud 
to the teacher those frrnes in which errors occurred. Corrections were made 
by the student and checked by the teacher. At the end of each period 
the last frame was dated and the book v/as put in the student's desk. (See 
Appendix, Sullivan Sample Plan Sheet). 

,1 , , • 

During the Sullivan Reeding period one teacher worked with students on 
Write-letter exercises while the other tecncher took one-minute oral reading 
samples. 

SRA Reading Lab 

The SRA Reading Lab lA was used with those children who had. completed Book C 
of the Distar Reading program. Stucents in the SRA program, as in Distar 
group Say-sounds, worked in two sections. During rection 1 the students (4-6) 
assembleU at the back table and each child first read a passage silently and 
then orally read one-minute samples of it to the teacher. The passages were^^ 
from the^ lab booklets that student? v;ere working on during Section 2. Te^^chfrs 
took the one-rminute oral recsling sci.iples doily vor each child, and recorded . 
the number of words read on a double bank counter. The cor/Tect an|d error 
scores were then transferred to the event sheet. Correct responses were 
defined as appropriate phonetic Imitations of the stimulus words; error 
responses were inaccurate phonetic imitations and repeated words. During 
Section 2, the V>frlte- letters period of SRA Reading Lab, the teachers 
gave each child the work booklet from the level he was then working in. 
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The teacher instructed the student to *'read to yourself the story that 
is on the front of this boolclet. After you have read the story, raise 
your hand. Then I will start you on the questions/' (See Appendix, SRA 
Sample Plan Sheet). For the questions, the teacher gave the child his 
Response Marking Sheet (see sample in Appendix) on which he responded 
to the questions on the back of th^ lab booklet. He was instructed to 
raise his hand when he completed the answers and the teacher would then 
correct his work with him. The teacher went over the error responses 
with the student and instructed him to "correct your errors, then raise 
your hand to call meJ' At the end of the period the total numbers of 
correct and error responses were recorded on the student's event sheet 
(Figure 9). 



SMi Basic Reading Series 

During the afternoon reading period (2:15*2:45) the SRA Basic Reading 
Series was used to develop silent reading and comprehension skills. The 
series begins with Book A and each book has an acconipanying workbook. All 
students began in Book A and proceeded as far as they could go through 
the series, which ends with Book F. This reading period was divided 
into two f ifteen-*minute periods. For the first fifteen minutos all students 
read silerttly; one teacher took one-*minute oral reading samples from each student 
while the other teacher gave assistance to the other students. During the 
second fifteen minutes the students made responses in their workbooks, raising 
their hands after two pages to request teacher correction. After the teacher 
corrected the pages he recorded the correct and error responses on the event 
sheet. 

Presentation Procedures — h\ath 

Suppes and Sullivan Math 

Patrick Suppes' Sets and Numbers srries, published by Singer/Random 
House, was the foundation for the math program. Supplementary materials were 
drawn from Sullivan's Prograimned Math Series (Book 4-Hultipl icat ion, Book 5" 
Division), and from teacher-made Basic Facts Sheets-Multiplication. The Suppes 
math series was chosen because it provided comprehensive coverage of both 
traditional and new math skills, it lent itself to continuous measurement, and 
it was being used by the elementary schools of the Tacoma School District. 
The procedures for responding to the Suppes math material were the same as 
those used for the Sullivan programmed reading materials. Numerals, rather 
than letters written by the student, were used to determine a student's rate 
of correct and error responses. Following the completion of Suppes Books K, I, 
and 2, students were placed in Sullivan Book 4-Mult iplication. Presentation 
procedures for this series were identical to thosf^ used with Suppes. Be- 
ginning with Sullivan Book 4, teachers began taking one-minute oral samples 
from students on the basic-math facts in multiplication only (see sample 
in Appendix). In addition, fifteen minutes of the 8:30*^9:30 period were 
set aside for students working in Suppes Book 2 to write the basic multiplication 
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facts. During this time the teacher presented multiplication sheets 
to a student ond set a timer for fifteen minutes with instructions for 
the student to complete as many problems as he could before the timer 
rang. The student's correct and incorrect responses were subsequently 
graphed on the six-cycle graph paper. 

Academic Materials — Placement 

Baseline Measurement Conditions 

The first experimental condition in this program involved taking baseline 
measurements and it consisted of two phases. During Phase I, academic 
stimulus probes were administered to each child so that his academic 
skill levels in the Suppes Math Program and the Sullivan Programmed Reading 
Series could be determined. Tne probes were made up of items drawn from 
the material in these programs. No teaching was allowed during the 
Phase I condition, and the child was given no reinforcement- -teacher social 
approval or disapproval. Probes were not corrected during the day so that 
the students were not aware of their correct and error responses. 

In Baseline Measurement Phase ti» the students were placed in the 
Suppes and Sullivan Programs according to the i r. performance on the 
probes. The individual teacher-pupil contact initiations were held constant. 
That is, the teacher intervened after a given number of responses in order to 
minimize student errors. This was done by stamping the picture of a hand 
with the word stop across It, and by using this picture to cue the child 
after a specific number of responses determined by the teacher prior 
to the child's placement in a bcolc. The hand cued the student to raise 
his hand. The place in the boolc where the hand picture was used varied 
according to where new sicills were to be introduced, and at these points 
the teacher had to teach the new sicill before the child could continue. 
Recording procedures called for the teacher to correct responses on each 
contact, and to enter the correct and error responses on the event sheet. 
The program time on which correct and error response rates were calculated 
was the time during which the child had actually made responses. The 
time during which teachers initiated contacts was calculated as off*- 
program vime and was not considered when calculating the student's rate 
of responJing. Baseline measurement Phase II continued for at least five 
days, after which time trend lines were analyzed; if correct and error 
responses had stabilized, the program vias maintained. If trends were 
unacceptable, changes were riad";; (see Trend Analysis). 

Probes 

The rationale for the probing procedure is that, theoretically, the best 
way to determine student placement in academic material is to sample 
student responses to that material. Decisions about such questions as 
how large a sample to use, and what percentage of correct responses determines 
book placement, are arbitrary, and they depend upon such factors as teacher 
philosophy and the time and materials available. In this program every 
tenth page from the instructional materials was used for probes, and 
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a student's book placement was at the point in the material where he 
began to show an error fate of 5%* 

The probes were compiled from Suppes and Sullivan material and were 
administered at the beginning and end of the school year. One hoi^r a day 
for three days of the firs^-week of school was set aside for .probes--a half 
hour for reading and a half^hour for math. The students were Instructed 
to respond to every question and told that no teacher aid would be given. 
A timer was set for thirty minutes, and when It rang the probes^ V'^f^f 
collected and stored for later correction and evaluation; 

StudfehM^ Book Placement 

♦ DItetar Reading - All students were administered an alph^i^et recogni- 
tion, wrjTing"^T"say^ test to determine their placement In Bojpk A or p of 
tiie^mstV series. Book C focuses on blending and all students were reqiJired 
to piroVess through it before beginning the SRA Reading Lab. 

2. Su llivan Reading - Book placement In the Sullivan program was deter- 
mined by th^'^lnt at which the student made 5% errors on the Sullivan reading 
probes. If Si errors occurred In tbe middle of a boq^, a student was. started 
at'^he beginning of that book in order to simplify administrative pr<pcedures. 

3. SR A Reading Lab - All students began at the beginning of t|he^^f>ab kit 
and proceeded through the material at their own rate. 

SRA Reading Series ■ All students began In Book A and proceeded through 
additional books at theli! own pace* 

5* Suppes Hath - Book placement In Suppes wa$ determined by the point 
at which the student began making S% error,$, on the math probes. 

Student Evaluation Procedures 

Group Evaluation 

^The Witlje Range JVphlevement Test was used for pre-post evalgatjon of the 
experimental and control classes, and was administered before Intervention 
pr6cedures In the .'fail and again In the spring after term! natloiji , of the project. 
Two Important Indicators gained from the WRAT test are: the student's mean 
percentile of change- in classroom ranking from the pre-testfto the postt^st, 
and the student's medn grade change from pre-test to posttest. 

An evaluation of these mean changes provided Information concerning the 
change In performance in terms of grade level and percentile rank. This 
Information indicates that while the experimental classes were maklng^^ 
significant, grade change (more than one year's growth during the sc^obl,^ 
year), the control classes made less than half a year's growth or grade 
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change during the school year (see Results section). That these changes 
were attributable to {nstnuctional procedures and. not tp Innate student; 
abilities can be determined by comparing the intelligence scores (on 
Stanford^-Blnet tests) for the control and experimental classrooms, taken from 
the placement tests administered by Tacoma Public School psychologists. The 
results ifrom these test scores show the experimental classes had a mean 
J^.d* seofe*{pf 72.3» while the control classes had a mean I* Q. score^of 
71ii»94^not a i significant difference. 

Individufl't Evaluation i ni 

individual evaluation for students in the experimental group was a contln-- 
uous process and required daily charting of data. On Fi^jday aftern^ns the 
experimenters from '.»^.e University of Washington analy^lRT'the wee1(*s data' and 
namd« re^tofunpe^ations for changes based on the trends ojf^$^ose.<J|i^a. For example 
^;wlien ^^st^idianft^made a high rate of responses ^ut^manf^i:hbsir f^sppnsef :were 
< errors, the. situation was often diagnosed as ^a: program prcAlem, an^. a. change 
to less difficult materials, or to individual Instructlm on a particular. con*- 
cept, solved the problem. It was important to Identify such situations qulctcly 
so that tl)e student experienced success In Ms acadefyic endeavors. Other data 
observatiitms showed that wl^n a;,^hild*s error rate was stable or rS.lowly. rising, 
and hiS'Correct response rate was on the decrease, an intervention wjtls. rein- 
for^ementsv (either adding points to the program, or enriching the ,4(c^dule) 
was sufficient to reverse the correct trend (see Continuous Measurement). 
Dally Individual assessments were not made in the control, clas^iaoms. 

* I. i » i 7> 

Continuous Measurement 

For eiFfectlve student plac^nent and, .c^tinuous evaluatldn'of, Mieth[9irr. the 
program Is meeting Its objectives, the teacher n^ds feedbacic to let him laiow 
"liPwi hi students are > [progress infv .ulnr(|<biirfo(pr9ject the major j)fif^od , for test*- 
Ing the effectlvenets^of nStudents^^pla^c;^m0njt^lr9nd subsequent prof ressirWfSi. to 
exmine their correct and error rates on a weekly basis. 

Because measurement of behavior provides essential information for 
placement and for decision making on what actions will be most iffffectlye.Jn 
enhancing continued learning, It has been suggested that ^^measurement of 
> behavior Is the critical factor In teachlng^^ (HfMrtjlr>g^i& PHi^Hps, 1971 1 In press) 

* > . 'Continuous measur^i^nt of academic perfor^f^iafic? Is greatly enhanced If the . 
academN materials used by students are progrimimed or semi *prog rammed, for 
these fiaterials are presented In a way whipji,, requires active responding on the 
part of the students Active responses may..be d^v^.ded into movement cycles 
(say sounds* write letters, write nun^rals, say words, etc.) which, when counted 
>rLoyef time^ vare neadi ly plotted on six-cycle graph paper as if a fee of 

performance. Other advantages of progrimimed Instruct lo((^,.ar|if-that Its step*by* 
step(>pfesenfcation of material facijl.tatias the analysis joif problems, it provides 
imi^late feedback, and \% all<^ tor $e|f**pacing by.^e f^tudent* 
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Taking continuous measurement involves several dlistinct and necjeisary 
steps« Firsts terminal behaviors must be established so that a child's 
fitia4Ye%s tdward those objectives cah be determined. In this pr^am/ for 
example, a terminal object! Vie in readifng Wuf^^that a ^tudi^t had to be 
able to say the name and sound of all ttid tetters in Oistar Books A and 
V^fore he bdgat^ v^rk in the SRA R^^i^^ tab. The second step is to 
tdk€^^b^setine datb (the initia^t measur^rtt of a behavior) %6 that later 
manipulations of variables (mater iaJ^; time sjpent working oh' materials, 
reinforcements, etc*) can 'be'^ana^iyied'for their effectiveness* The thil^ 
step i^ to detj^nrirne whdt n^iA^ofcer^' Will be effective. After taking' ' 
bi^i^tiKt^ dat^AHiifid anafyifiniSf^l^ ch^i td'*#^ Responses, the teacher must evartifate 
hOKf^he child' H perfbrufHi^ and then determine what clVang^s or manipuliitfons 
(curriailar clfaAgei' ^d/dr reinforcing cbntingencids^ wtll best elicit accurate 
and efficient responding from the child* Finally, th^ teacf^r mdst evaluate 
the effectiveness of the manipulation which occurred following baseline. 
F^of «ll^s reason' it is imf^^fative' that only orffe cdndition at 'a time be 
chafii$^; otVrisrWise, ii:' is^ iii^s'sibti'^fo evaluate i^ther a given manipuldted 
v^iab(e i(#as tt^ detemiirtrng'-fdCtdr^M atiy' performance change. If this 
procedur^*^fs foltoifiiiid it is poi^^fbisj ;after seVerdt sessions, to coMpare 
tlie'%tud^t*^ baselNe respons^ Vate data with the' response rate arid then 
to evalVrat'e tf^ effect of ttte dliange introdu^^ into'tfie learning eriviroi^nt. 

C(HitiniK3ite''mea^uf'emOnt based on response rate ^ ^enables the tedder to make 
coiipdriioiVs of performance for the s^r^ individual at dfffereAt t^mes-^ ^ 
regaf'dVess^ Of the Vesf^se peri^dd as I'Ong as the responses are colorable*' 
(Harini^ It Phf1fips,T57f',^n press). THef value of tHI^^ ts thot instruction 
is truly IndividuaTt^etf^ for the child^ii progress is beincj Compared onTy 
to his own past perfOrttence. ' ' ' ; ; . j 

Contfhuods M^asur^dmenfg^as a Diagnostic Tool ' - 

The prfmat^ 'fundtidn of any edueational^ diagnostic toot is Uo aid' * 
the teacher in designing ain educational program 44iicR wili A^t 'tHd ni^d!^ 
Of the individual itudirfit ;(Haring $ iovitt, I967, p. 36). ' Sei«6r*dt iSi^ts 
Hof 'xiontifiuous measurdnlent'ffbke' toot <particutar1y 

suited to achieving that goal. The first is direct assessment Of obslifvabte 
behaviors, a procedure that permits the teacher to immediately and relevantly 
program instructional materials in a functioharseitirliil? ^Th^ seidM /^ - 
diagnostic characteristic of continuous measur^nent is reliability. 
Sirt6e;the measurments Si^e'fiiade ovei^ in extended time period dhd'ln^lve 
maity ^Valuations, the opportunity fdf* ^behavior to stabilize is inherent 
f^* the prc^^ure. The third diagnoStfcal ty sound characteristic of ' ' 
continuous Aieasurement is Vdlidityi because ccm^tinuous measurement ' 
is takdhjon day-to*day activities,' it provides performance informatfoM^^^ 
concerning discrete tasks; this is thd type of information a teacNir 
requires in order to design individually relevant programs* 

25c 



' •'< • -> i. ■ .... • rv '> (I. i ' . 

' i Thr<3iygtwot itH I $ 'program; rate <of movements-per-wlnute) was the vnlt 
of ii»9«suii'efliBWt ami It was a!!way$ eaf^ulat^ for both correct and u 
erttr ^es^Ves; liate was us«d beieayse It fce*t enables the teacher to' 
interpret the three crltl-cal -i*lkneiwlons of a pUpM's academic pei-fonriaj»ce : 
"(a) Preqtfenev - how many right and wrong answers ;• (b) Quality - what>^he 
correct to error ratio Is; and (c) Time « how -long t* took to perfdrj» n 
the task." (I^ovttt, Schaaf, » Eaton, 1-970, p. . 18) Cdrrect and v 
error r'ates gi-^e the teacher ell ithree of «hese pieces< of information. , 
roryffl»tance, rate teHs the teacher the frequency of responses, and the 
ti*e needed 'to do then. In addition, wheni^th correct and err^r ra.tes .i 
are talien th* teacher is provided with either a ratio or percentage = 
Assure for comparing the two. j . ^ . > 

•the two netessary erenents '%then one uses rat# as a ibasi.€> measurement 
■'■•ate^mivtmnt cycles^ianrf time. Movement cycles are behavtors perf^nrnD 
mancei which have three distinguishing character isties.;'^ FJipst, they^^re 
actions? whJch have a def tRfrfee beginning and end; second, if hdy are ; .. 
actions which aare repeatalblri}iendithlrd, they are-actions whi^h are iunden 
^ the ' students ^^ntroU < A mov€«^treycl« is a specif ic iacti^Xn whl«h 
can be counted. The task for educators v^o wish to measure rate Is 
to sisparete !acad^*c.it»er#ormances 'Intoc^ units whi-ch start and ' 
stop. Examples '6f>>someibasic'mwM«nt cycles' are: say> word^^ say^etteri > 
siy number, write- letter, write number, etc. However, counting movement 
cytfes Without recording the tfme In whlch they oc^red woald .yfeidi 
very Itttlef useful information^. For eiiampJe, if Ron writes SOwords 
correctly and Doug writes 200 words correctly it- would ^superficially 
appear that Doug Is four times better at word-writing than Ron. Dowever, 
If Doug wrote his 200 words inj twenty minute* and Ron wrote; his. gOi^wrdsj 
In five minutes, then they were both writing at a rate of 10 words per 
minbte. ' The fact that tite movM»ent cyblevls iinder''tHe student^s control 
mean* tHat^'the teacher can, through manipulation of environmental :>;• 
tontlngencies which will depend on the stodent^s behavior, helpbthe ittudent 
maintain, Increase, oridecrease the rateiatr^^twhich he performs the behavior 
•^ibelng'coonted/. 'V- :. -ii ,!•■ ■■ 

tftt,vyfii . i , .|_,. .. >. , ^ ,...1 . ' " 

EvaHiatlon Procedures; Trend = Ana Ws is , , . 

Analysis of trend line was used for evaluating allnplott^ data in iJ- 
th4s program. _ The procedure for' establishing trend lines Isias foUotaur, 
For any givto group of data plots, one must divide the data -Joto twoc equal 
parts, and then find the median, and midriilddle point, of eacli half..!; 'Tliese 
tvoo points are then connectedi. One f lnds< the m^lan point 1^ counting <fi 
from thi top or bottom to the c«iter horizontal position of the^data^ . uo 

The mid-middle point Is located by counting from each side to the 
center vertical position of the data (Figure 10). The Interpretive 
Information yielded by a trend line Is basically descriptive-- It tells 
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you whether the students performance is decreasing or {ncreasing 

or ^ther it ts holding constant. This information gives the teacter 

a sensitive indicator of a student's past and present performance rates» 

and enables htm to mal^e sound decisions on curricutcm material or reinforcMMt 

changes in the student ^s program. 

When the experimenters in this program analyzed trend line direction 
and made phase change decisions based on that analysis, they fottoMed the 
general 9 rute-of*- thumb guidelines shown in Figure 11. 

Close analysis of trend 1 ine acceleration (i.e., movement, either up 
or down) can be a sensitive indicator of stjdent performance , afKl one 
of tlie tools utilized by the experimenters to determine trend acceleration 
(positive or negative) was the Acceleration Finder, a clear plastic 
strip produced by Behavior Research Co.*npany (Figure 12). To determine 
positive acceleration (up) the Acceleration Finder Is placed on the 
graph so that its Xt point covers the medians-midpoint of one side of 
the data (Figure 13 )• To determine negative acceleration (down) the 
Acceleration Finder Is placed identically but the plastic strip Is 
turned over (Figure 14). 

After the Acceleration Finder Is correctly placed on the data. It Is reatf 
by following the line which covers the trend line to the arrow head and then 
reading that figure* Positive acceleration Is indicated with an (X) before the 
number while negative acceleration is Indicated with a (^ ) symbol. Such an 
analysis of performance calls for a minimum of five data plots and can be the 
basis for making phase changes. But the analysis of the effects of phase 
changes calls for a comparison of pre-phase change trends with post-phase change 
trends. On the Tacoma Project these comparisons were made on the QMarterly 
Report forms and Included a description of Median, Trend, and Range (Figure 15)# 

Comparisons of pre- and post^phase change trend lines tell the educator 
how RHich effect a given phase change had on a student *s performance over time. 
When using trend lines a comparison of pre-phase change projected medians with 
post-phase change actual medians provides the answer. For example. 
If a trend line had a XI. 5 positive acceleration for a three-weel( 
period, the median each weeic would increase !n the following manner* 
Putting the median of the first week's data at 1«7 movements/per 
minutes/per day (for a beginning point), then the second Vieek'^ median 
would be (1*7 X 1.5) or 2.55» and the third week's (2*55 x 1.5) or 3*8. 
A projection of this trend into a fourth, fifth, and sixth week would yield 
the following medians: fourth week (3*8 x 1.5) or 5.7> fifth week (5*7 
X 1.5) or;;8*5, sixth week (8.5 x 1.5) or 12*7. However, If a phase change 
had been Instituted following the third week, and three additional weeks* 
data were collected with a first week median of 2.0 and a x3.5 positive 
acceleration trend line, the fifth and sixth week medians would be as 
follows:'' fifth week, that Is, the second v^ek of phase change (2x 3*5) 
or 7-0; sixth week, the third week of phase change, (7.0 x 3*5) or 24*5 
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FIcure 11 

IUjle*"of*thurob guidelines for i^glemefiting phase changes 
Trend Direction ^ Possible Prugram Change 



t. Correct rate acceleration 
with error rate 
accelerating. 



2. Correct rate acceleration 
with error rate deceler** 
ating. 



3* Correct rate acceleration 
with error rate holding 
constant. 

4. Correct rate holding 
constant 9 with error 
rate accelerating. 

5« Correct rate holding 
constant, with error rate 
decelerating* 

6. Correct rate holding con- 
stant , with error rate 
holding constant* 



7« Correct rate decelerating 
with error rate acceler- 
ating. 



8. Correct rate decelerating 
with error rate decelerating 

9. Correct rate decelerating, 
with error rate holding 
constant. 



1. No change would be initiated for one week 
unless one of things occurred; 1) cor- 
rect rate decelerated or 2) error rate main- 
tained acceleration. See # k for type of 
change to make. 

2. No change. 



3* No change* 

4. A cost response contingency (points are 
subtracted for too many errors) constructed 
for error rates* 

5* No change* 



6. Depending on the desired rates of both dimen- 
sions (correct and error), the correct rate 
reinforcement schedule might be enriched, 
while error rates might be ignored. 



7. Five possible treatment alternatives can be 
considered; 1) lower teacher contact 
schedule, 2) additional practice, 3) place- 
ment in lower program, k) enriched rein- 
forc^nent schedule for correct responding, 
5) combination of all. 



Same as 6. 
Same as 6. 



^Chart line direction 
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Figure 12 
Trend Line Acceleration Finder 
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Figure 15 
Summary Chart of Phase Char^ge Effects 
Sample 

! Rules: 1. Same signs (x or ♦) are divided. 

2. Different signs ^, ♦ or ♦.x) are multiplied 



.•set In* 



f 

{fects of 
inge Number 



in- 
fects of 

inge Number 
a* 



Rate Oescrfptloft Effect Description 


Hedfan Irend Range 
Per Per 
Weeic Cond • 


1 




Hedfan Trend Range 

Per Per 

1 Week Cond^ 
< 


Meei fan T rend Range 

CKange ^ 

^Him/my C?/;sm/m^ 
wk wk 

^^Me/^ E^^i^jSm/ny 
wk wk 




Median Trend Range 
Per Per 
Week Cond. 

ci'.s- C+iiM' Cjjiof}/: 


Hedfan Trend Range ' 
Change 

^ wk wk 

EWj^m/m> E$/.im/Rb 
^WK wk 



Range Change 
Not Calculated! 



m/m/wk*mean^ movements per week 



(Fl^rie.U6)V fh% rcUlatlbnshljtiietween the projected trend Itne and the 
actual trend line can be analyzed by dividing the smaller trend acceleration 
number (xK5) into the larger fx3.5), I.e., x3*5/xK5 or x2.33. This is the 
deviation of the post-phase change trend Tine from the projected pre-phase 
cha.rtg«t tVeind line* ^ 

Phase changle' effects were summarized quarterly on the Tacoma Project and 
recorded on the Classroom Quarterly Report forms developed at the Experin^ntal 
Educaticih Unit (Figure \$y. 

_ Contingency Management 

After bd^iet'the data have been collected, trend lines have been analyzed, 
and the dec is; tdn to tHUnge rteiteflals or establish .^sequences for responses 
has been reached, the teacher vA\o is using a toicen # inforcement system 
is then faced with the problem of determining payoff schedules and establishing 
item costs* A haphazard establtsNnent of payoff ratios and costs can' )«ad 
to situations in v^tch some students are never earning em>ugh pbTnts "to 
buy Items, while other students are able to deplete the ^'store** within 
a day or two. To prevent such occurrences, arid to provide a situation 
which the students consider equitable, the experfmenters used the following 
formulas for estabi ishiifig pdint^iftarniAg Ratios and for determining prices 
for reinforcement items: 

K Establishing Point-Earning Ratios « 

a • The Subject's mean rate (moven^nts^per-m i nute) 

b - Total session tline 
, c ■ The ex|)ebted nuiiri>er of responses per session, or (a) times (b) 
The, itmbk^^f fhlnut^'^iavai table as a consequence 

fki^lefr [ A^p^^ of respbndlf^ In a session of ten 

-minutes lis' fifty.' The ni^nber'Of minutes available as 
" '''6 consequehfce^^ 20. 

' SolWtdn '•' ' • .'.'.-* 

i^^a'^M ti ^te-^ SO . 
K -^*^essT6h tSfiie - 10 - I , 

c m'-'^ k 10 - 500 responses 
d m Time available « 20 ' 
e - Divide 500 by 20 - 25:1 

' tf th^ Subject eifns oYie point for every 25 responses, and .J poinitr equals I 
minute of free '¥MH», the Subject has earned enough to pay for the free time. 

• •■ ' . 




2. Deurmintng cost value^^pr number .of ^potnts. required to "purchase" 
afi?3i;tjwi ,^ , . i-. 'irm.' ' i: .i .L 

a ^ Tl!^. SiiAbJect'si mean rate (movements*per*minute) r ;:.7 
b ■ The average session time i ..^ ^.i 

c ■ The expected number of responses per session, or (a) times.. ,(b) 
d « The minimum number of sessions you want the Subject to work before 
.he is ai^l«^/to "purchase" the desired consequence. 

ii e The nuir^ of responses expected, or (c) times )(d)i| 

f « The ratio desired (e.g., 5:1f 10:1, see #1) to obtain item, i^n 
9 - Desired "cost" of the item, or (e) divided by (f). 

Example : The Subject's mean rate is 50» the session time is 10 
. i, ; minutes, the number of s^essions before payoff is 10, and 
the desired ratio has been .;de term ined through using 
} formula I to be 10:1 ^ 

Solution: 



a « Mean 'itaten? 50 at.' jn\^ rir,-. . 

b » Session .time » 10 u. :.-i:ihLj;j ^m'wc ;>I . ■; . 

c I" 50 ttnes^lQ « 500, ..jo ^lou? jnovoi^i .-.wj ■ 

d ■ Number of ;ses$ipns * JO H ,f ? < 

>i Me.p Nionber of responsf^^ ^^c times d) * 5fOOO ri 

f ■ Desired ratio « 10:1 . 
g « 5,000 divided by 10: The purchase price of the item should be 
500 points. '/! 

Reinforcement contingencies used in this program were usually free 
tiilie an<jhiteiiis or games which were knpwn to be extremely interesting to the 
students, such as car models. When a student purchased free time, a timer 
(set for the number of minutes purchesfd) waSi place^ pn 4iis,.dfsi(« The 
student. thenriwento*Of;the ^ifMvities area whe^i^ he^cpy^d engage] j^^yi^t ever 
activIty>hlfvthose,/.'$^{as!j^ui1ding models,. plavjjigppopl, doing puaezles, 
painting, listening to records (with a head set) ,M|9fKi. playing with a car 
set. When the timer rang, the student immediately returned to his seat 
for further academic work. Students were allowed to spend f^ptsifor time 
only during those academic periods in which they were earf)ijrHri^1^t$* The 
cost for time always remained at the fixed ratio of .1 point for 1 minute, 
and a student always determined how many poln^t^^ ofoijlis. t^ltaj would spend 
to tHiy time during a point-earning period. i. ^ i i > 

<- ■ ' 

When trend line analysis of a student's performance data indicates 
the need ifor a program, change »v thei>teacher has several ^rses of action 
avatibbJf#. ilte may inaniputatc(.d)eachi.(ig proc(edureSfUcontapt)'freqyency> etc.) 
or the programed material, or he may manipulate the arranged event (these 
happenings which arc contingent on a pupil's behavior). An arranged 
event, for example, occurs when a pupil receives X number of points for 
correctly solving X nimiber of problems. An illustration of the contingency 
management procedures used in this project is found in the following case 
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study of one of the students. This study has been reported in the 
April, 1971, Issue of Educationai Technoiogy (Haring, 1971). 



^^.Juanita was put on a, fixed ratio schedyle of tolcen, reinforce- 
^^ment contingent upon the number of responses written 

which were correct the first It tme. ^or>yery five correct 

written numbers Juanita received one pojn^. One point 

equalled one minute of free time. Kece^k for fifteen 

minutes beginning at 10:30 a.m. cost twenty points. 

Candy, }ack%f and other small items could also be purchased ^ 

by any member of the class at a predetermined point 

value^ The teachers determined the ratio schedule. [Juanita] 

determtnecl how anci for what h^r pclnts would be used. 

The alternative program if the child did not hfvfe 4X>ints 

to attend recess was Suppes Math.... 

During the [next] fourteen days puanita] was subject td k' * - ' 
5:1 fixed ratio schedule contingent upon correct write 
nu«ib|^r responses.. • [her] m^ii|n correct response w^s 1.5 
respphses per >inute. Duf .ing tlie 'second' phase 'of b^s'c^l ine 
measurement when slie was worVin^ tn ^ bp6l(» the median 
cpffect rajt^ had been 4 co^^^^^ Vespoiises per mfnute. ' 
Although correct.^ re;5ponse rajie^ during the fJrst fourteen 
days pf the^expeHmehtal cbh^^^^^^ of^f ixed rptio jtokep 
reinfprce^t showed si ig(ijt f)^^^ the' 
teachers determine^ that, a 'second experfmehtat comiltion 
should be instituted as an attempt to raise the median 
level of correct responding. . ..Ii:herefp^i;e, following the 
fourteen days of baseline'<lata| one comfit ion was changed. 
The points necessary to buy recess were reduced to 10. 
This diti, in facV,^1se the m^fan le^tfl o'f 4brr^c^" -^i' ' J-i:.' 

^ responding to 2.4 correct responses per minute. It also. ^ 
dr^^l^ically changed the sifope'of the best fitting strai^^HV 
. line projected througH (the next], seventeen days of dat^.' ' z'*'' ^ ^ 

' font jiytgehiiV Cod i pg : tontact Cod ek Z"^'-'' * ' '''' 
^ ^ ^ ^ ' '^^-' ^ -'^i " ' * .nr. riJ^ff: bni 

•n^/>rde/ .to keep track of the pqint-earning ratios and the teacher 
contact kcjiifdi) I eS for. eacK student, a contingency coding ^^yst^' war Wpd. 
The code was fitaced diVecitl.y under the aciaddnlc subject tl tie ' btf the evert't 
sheet, enalit tj^'^fef^^^ to quict<ly det^rmln^ at ^ch contact^? • 
if the studei^t Ws W a polht-earntng ciihtrtigency , ahd how many points 
he had earned. The number of pplnts earned was calculated and entered 
on the event sheet tp the H^ht| of thie Correj^t cblumh (Figure 9?.*-* 

The coiJes us'ed on the project were baseid on the 'ConUngency ' Coding 
System developed at the University of ^/ashlngtoii' Exiierlmdiital Edbcatlon iJAlt 
and were Interpreted In the following manner: 
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nv . .-.-nh; .,• . , . • .J.. 

^ the 5 ipeciHei'il py|>11-lnitidUd contact. 

T^ie number uncrer^l--I/i thrs case, Id— Is writ tert vertically, 
^ 'and means thai' tfi^' student must mil^ 10 responses t»ef6re 
rafsl(i9jhl5 h^'nd, \ , 

12 500 "'''"^ ' ' ^ ^ 

• . < ' t^'..n»fr . . • , , . " 'f: i* 

^' 'The ^^.^f^ Interpreted the as tn ex^fiq>le II- The VP 
indtcates that the student must cdrtipVete 1 page before 
raising his hand. 

13. SI** 

16 ' ' 

0 :^ , ' ' ' ' ' • ^'^ ^ * 

.in this exaiiiple the 5 and 10 mean the same as in exan^le 1. 
oni yi^.'^ foi towing the 5 Meanp that th6 teacher is giving 
polnTs to the child foi^'^borrect response^. The 6 
under the 1 tells the teacher to glv^ the child 1 point 
' for every 6 correc.t responses, a 6*: 1 schedule. ' 
the'^ In this ie)can«>1e Intf^cate^ '^to tt^ teacher that the 
pupil will specify how and wh^H dui^Ing ia point-earrting 
session he will cash In his earn^ points^ 

ResuHV and D>scussi6h ' '^'^ ' 

Test Selection and Ailmlnrst ration: Wide AchieviCTteift T^t -i 

The MffJjJ was select'a^ as the means for^iviakjng a cpmpariison <9F^stt'dents * 
academic perfom^We th'ihe expert men^^ and ci^lritror classes. Deti^rmining 
factors in the select icfn were the following: a) test administration tliM Is 
short; b) no special slcllls are required for administration; c) both reading 
and math are tested; and d) the test has ^en ^^iMdardized.. ' ' [ 

'^[y^ WRAT^was acbriinistercid to all clashes (expef^fmental '"$kd cdiitrol) 
by tfie. ^experimenters during the week of Q&f6tier 15» I^^O* ar^d^durlng 
the week of May 20, tgf^>1, fol lowing pr^9ject\ ter^ jfhfe*«tes.t 
was administered and. scored as directed. by the! WRAT Instr'uctt^bf^ Manual; 

Results were compared oh a i:1assr60m basis ai^'y\€\ded a prei^pbst 
mean for each subject area. The differences betwe€in theie means were ' 
determined and gave the mean growth (or lack of growth) In eafh subject 
area. for .each classroom' (Appendix E). ^ 
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Results and Interpretation 



Each classroom's pre-*post grade standing for each academic area 
tested was determined by finding the class mean score (x1 » pre-score, 
k2 « post-score) on the WRAT, The tests were administered eight months apart. Tte 
difference between these means (712- Xt) gives the number of months* 
grade change (up or down) that the class made. According to this method, 
if a class advanced eight months (.80) then the class had been advancing 
academically one month for each month's worlc. The chart (Appendix E) 
shows that the students in the McCarver classroom (as a group) advanced 
1.40 (ten months 4^ k imnths » 14 months), or 6 months (t4-8«6) more 
than was expected, in the subject of reading. By the sane method 
of calculation, the Edison I classroom regressed (as a group) by 
one month (8-9« -1) over the same eight month period in the subject 
of reading (Appendix E). 

This chart also shows that in the subject of spelling there 
is no significant difference between the experimental and control classes. In 
light of the fact that spelling was not formally taught in the experimental 
classes, it becomes even more clear how effective the experimental pro- 
cedures were, it also indicates that very little transfer carried over 
[ from reading, suggesting that if progress is desired in a specific 

I subject, then that particular subject will have to be taught in a structured 

f and emphasized manner. 

i 

I A standard t test (Edwards, 1967) was used to evaluate the pre-test,post- 

I test differences between the control classes and the experimental classes 

I for both reading and math on the WRAT. The t test analysis was performed 

I on both the grade placen^nt change, and tt^ percentile change. Grade 

I placement change for the experimental classes for both reading and math 

\ was significant at the .005 level. The percentile change for both 
reading and math was significant at the .05 level (Figure 17). 

Discussion 

An evaluation of individual rate changes paired with the variables 
of curriculum, time of day, and contingency manag^nent provides a sensitive 
indicator of the effectiveness of instruction. Teachers need this information 
for developing effective individual programs. Administrators, however, 
need more gross group measurements in order to make their decisions. For 
, the administrator's purpose then, classroom comparisons with such tools 

as the WRAT can provide the information necessary for determining what 
type of instructional materials and methods are achieving the most effective 
overall results. 

A comparison of the experimental classes with the control classes 
on the Tacoma Project by the method of mean growth shows that in grade 
gain for reading, the experimental classes averaged It months gained 
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Figure 17 
"WRAT Reading, WRAT Math 



Experimental Grade .Placement 



a. 



T = 2.6533 
df.=i»l» 

V< .005 



Experimental Grade Placement 

T = 3.^338 

df.=Aii 

J, I 
' p< .005 ' 



Experimental %ile change 



Experimental change 



T - 1.7016 
df.= kl 

%<.05 



T = 2.1129 
df. •''♦3 

"p<.05 



a. Comparison of experimental and control class grade level gains in reading. 



b. Comparison of experimental and corjtrpl class percentile 9aicis*.^.^n reading 

c. Comparison of experimental and ^bntro*! class grade level gafrts in math. 

d. Comparison of experimental and control^ class percentile gains in math. 



while the control classes averaged a 2HM>nth decrease, in math the 
exfwrliiiental iclasses achieved a mean gain of 14 months. The control 
classes made a mean gain of 2 months. From this information it is :easy 
to see thac the experimental classes made significantly more progress . 
in reading and math than did the control classrooms. 
* » ' ' > 

i Evaluatton of SMppes Math and Sullivan Reading Perfowaac e 

i •: ... . , ■ ' o , ,.. • 

I Introduction ^ >, 

I — — 

I .Selection^ of $til1lvan and Suppes was based on evidence (Harlnget el 

I 197(9 that|t:he performance of children on these programs shewed a refiirii^fy small 
error rate.,, ..Ey^n so> these two pragrams are at'heiV^only a crude approxi- 
mation of the jcMiJ^tiye to achieve an errorless prbgram. An analysis of 
each chlld|s performance by am^amf pm.was carrl^ out to examine tto.i^te > . 
^ of error by book for each program. - 

i 

; ComfHiter analysis of the Project's data was made for the Suppes 

' Hath Program and for the Sullivan Reading ffiagr»i. For comj^ratlve 
f purposes nprnjng wortc (a.m.) was analyzed separately from afternoon 
woric (p.m.), and baseline data (Su^'s) were' analyzed separately from 
intervention data. Each student 's correct and error rates were eva&iated 
by finding the mean, standard deviation, median, the minlmimi response ^ ^ 
mode, and the maximum fespcmse mode (ran^). These measures were thm n^. t 
taken on the experimental classes as '^Ef'gfroup. 

Using the mean In conjUncticm with the standard deviation provides^a . 
fairly accurate interpretation of where the data pV4^ts are'<iccurring*!i;i.' > 
especially J.f the standard deviation Is* a relatively low^ figure. 
When the standard deviation is high, however, the probabl I ity If that 
the mean is being putleil up or down by a low number of atypical plots. 
In such instances the Indian is probably a more accurate indication of 
where data plots are ocdirring. 

j ' r 

Analysis of Charts in' the /topendix . i. u. 

* ' * n ^ 

I. Chart A(pages 1*8): Suppes Book I, a.m., p.m., and Suppes Book 2, 
a.m., p.m. 

itesults: These charts provide a comparison of a student's < . . 

correct and error responding rate between moriflhg and afternoon performance , . 
for Suppes Books I and 2. ^^ i.:;; 

For Bc^l^ If the correct rate mean-median measurement was higher in 
thfi.jmrnljnf for /ei^ht of the students, no different for one, and .htf'gher.: 
in tm afternoon .for ' four of the students (eight students had ^no^ffternoon 
math, so no cougar 1 son can be made for them). However, the^overall >i 
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class mean-m^ian was higher for the afternoon. The reason for this Is that 
the eight students who did bet^r'ln tife mprning tended to respond at, only 
a slightly loi#r rate In the afternooiv. The students with the higher efjterr; .^q. 
noon responding rate, rhowever, tended to respond at a much higher rate ,fjn tjm i 
afternoon than in Aithe nornlng. 

A morning-afternoon comparison for Boole 2 shows seven students responding 
at a higher morning,. ratfetyend fWe students responding at a highpr ^fjciernpon 
rate. ^In, the class 'mean-median correct respond Tng rate is'srightly " 
higher for the afternoon. The error respomling rates for both Suppes BooM,;! . 
and 2 were slightly lower for the class average during the afternoon seskTon; - 



A comparison between. Books^. I and 2 resppm^ing rates <morning and af^eri^n) 
shows th4t a) 52.3t of the studenits increased, their correct ratesy;,.MM !• » • 
decreasing 'thet4V<«rror<;rates, b>..^. St of the studimts. i(howed. lan increase ;ln 
correct aQ^ errnr raites. c) 33.3t rof the stuftfnts M. a decr»«se,;in, both ( , 
corrects and errors, and d) k.7% of the students had a decrease In correct ,ra^e 
and an Increase In error rate (Figure 18), The class mean correct responding 
rate for Boolcs,^;.4nd 2 changed from 3.6 to while the mean error rate. . 
changed from O.tlj to,.0.06, (see Appendix D fharfs),, 

■.o.'iifi' ■ , ir; ■•• . -o'vl""-' i' ., « • 

lnterpreta<lan.if An. analysis of I nd.iv(idMfi,l, student mean corr^e^it and 
error response- rates,, „fqmR8r I ng morning jSfid. aftertipon . performance h 
on Boole t, shPNSulthat tlRCfire were no sigulf ii;af»t differences bet^fefjut the 
morning sesflion and/.the. af tarnoon sessiofi<,A )camparlsoo of students' 
morning and afternoon correct and error rates on 6ooi< 2 .shows that 
the error rate for Book 2 was significantly lower (p.< .0$) for 
the afternoon Aaap iron,! (Mith no significant difference In correct responding 
rates (Figure f:(a)><.<d^hasei!cqmp!W'lsons lead tp^Mie conclusjon that 
the students performed) itts> we I V*> as isny respq^j^es , In the 

afternoon as t|f). the n^rning^; ;<|n addition, a comparison pf Suppes Boole V ... 
morning and afternoon, icprrect and error response.^. rates toiSuppes, ; • ,^.,1.. 
Book 2 mornhngrartd aflternoao correct and error response ;p#tes showj.pr , ... " ju.- ( 
that student correct response rate for Book 2 did no«,id,l^fer signlf jpant^ty ■ 
from that for Book I. The afternoon error rate for Book 2 was, however, 
significantly lower (p<.OS) (Figure 20). This Indicates that 
although the material was more complex, students were tpaifitaining the4r.t . i .... 
correct responses ti^ile decreasing their error respohsies. *~ " 

• '"ofe ?of,.M;< !>!•! . ".t: ...vv -I ,!•) 

Discussion . The optimtm learning situation is condition (a) In t4ilch 
correct response rate Is Increasing, error responses are decreasing and the 
material Is becoming more jcofprax. and jJIfflcult. Condition (c),,f!lfl ii 
which erroRiiTfisponse ratc^ lis idecreaslag while there Is a>Mable or C7;, 
slowly decreasing correct response rate, is acceptable when material . , J 

level Is Increasing In complexity. 

The elfi|€it^yaDen.of the precisji^ teaching techniques used. in>tHji Taeoma. 
Project rtiwtH poogram .U; demonstrated ibvi the fact that 85.3». (U)) oe,,?i<Mt.y-8^ , 
students met the ■ requJ rements.^of conditions (a) or (c). In condltjpn (b) . 
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students show an increase in correct and error rates; in condition (d) they show a 
decrease in correct rate and an increase in error ffti* The three students whose 
worl< fell Into these condi tions—S-S* (2) in (b) and k.7% (I) in (d)— had borderline 
situations which were not significantly different from condition (c). 

2. Chart B (Pp, 9-29) Sullivan Bool^s l*10t First and Second Sessions > 

Results ; A comparison of first session means to second session means for 
the class averages on Sullivan Booics 1 through 6 shows that the mean correct 
responses were higher in the first session for Booics I, 2, and 6, and that 
the error responses were higher in the first session for Booics 2, 3» 4« and $• 
There were no differences for Boole 6. Analysis was. not made beyond BcK>ic 6 because 
not enough students advanced beyond it to warrant a corv^>arison. This comparison of 
first session to second se'ssioA shows that providing a second hd1f<-hour of woric 
immediately following a half^hour session produced no consistent changes In rate. 
The conclusion, then. Is that these students can and do worIc for long periods of time 
at a high level of performance. 

A between-boolc conv>arison of correct and error response means for the first 
session shows that the correct rate went up on the even numbered booics and in 
an inverse relationship the errors went down. For the second session no such 
relationship Is evident. During this session (the second session) the correct 
responses tended to increase steadily as the error response rate increased slightly 
and then held steady for Booics 5 and 6. From these results it seems that the booics 
in the Sullivan Programmed Reading series increase in difficulty in an uneven way. 
For example, a teacher might find that increases in correct rates are consistently 
higher In the even nun^ered books. 

A between-book comparison for individual students shows that as the students 
moved into more complex material (higher book numbers) a) 21.7% of the students 
Increased their correct rates while decreasing their error rates, b) 2k% of the 
students made an increase in correct and error rates, c) kk% of the students had 
a decrease in both corrects and errors, and d) 10.3% of the students had a decrease 
in correct rate accompanied by an Increase in error rate (Figure 21). 

Discussion : The Sullivan Wrl te-letters period was for one hour In the afternoon, 
divided into two half-hour sessions for purposes of evaluating the effects of 
tlfi^ on response rate maintenance. No clear differences In correct responding 
rates exist between the two sessions for the two classes. However, the decrease 
In error rates was significant during the second session for four of the six workbook 
compared. It would appear, then, that the extended work period did not create fatlgif 
or disinterest in the work, but instead resulted in a maintenance of correct 
responding rate with more student attention being directed towards elimination 
of error responses. 

3* Chart C (Pp. 30^39) " Suppes Baseline and Intervention 

A standard t test (Edwards, 1967) was used to evaluate the relationship between 
Baseline correct -error rateSt and Intervention correct-error rates. The effect 
of Intervention on correct rates was not significant at the .05 level. However, 
the effect of Intervention on error rates was significant at the .00$ level (Figure2: 
The significant change in error rate can probably be attributed to the fact that 
most phase changes (Intervention) were instituted for the purpose of reducing error 
responses • 
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Individual Acadmtic Histories 

Of 

Experimental daises 
Aeaiaeiwtc Case Summaries on Sullivan. Su0pes and SRA Material 

1. June'T. began Sullivan Book I on 9/28/70 with a correct Write- letter 
"^f^ding rate of 5.0 letters per minute. Her error rate was .1 letters 
pei^tnlnute. At termination she was working In Book 6 with a correct rate of 
5.5- letters per ttflnate and an errdi- rate of .02 letters pef mlvHite. June 
startM In SUppes Hath Book I on 9/21/7) at an initial rate of« ^.2 numbers 
correct' per ml^te, and '.Oii errors per minute; /|t termlnatloh'she was working 
on the 1att<^> part of Bo6k 2 and was responding at a 9.1 P«r minute correct 
rate with a .00 error rate. At the end of the school year June was working 
on basic multlpl lection and division facts. The SRA reading program was 
started on I/I 1/71 wUh June In Book A; her Initial correct reading' rate was 
kO words per minute; -ftVid her error rate was 5 words^per mimite.- At termination 
she was re«d1hg 51 eorr««;t Words per mimite, with Errors In Book C. June's 
correct rate trends continued to rls«f with an increase in material difficulty, 
whlTe her error rates decreased. 

^' ffafca'^y P . begkn Sullivan Book lA on I/I8/7I with a correct rate of 
5.1 letters per ^nute and an error rate of .06 letters per minute. Robert 
started in Suppes Math took I on 9/28/70 at Initial rates of 4.2 numbers correct 
per* minute and .2 errors per minute. At termination he wan on the -latter part 
of Book 2, he wis respondi<»M at a $.5 per minute correct rate and a .03 ^r 
minute error rate. At the^^nd of tlie 'scool year Robert was working on basic 
multiplication and dlVi<l4)n facts. Tlie SRA reading program wa» started on 
I/II/7I with Robert in Book A at an' initial correct reading rate of ^3 words 
per minute. His error rate was 3 per miraite. At termination he was reading 
96 correct words per minute, with 0 errors in Book C. Robert's correct rate 
trends contfnued to rise with an increase in material difficulty ,'twhlle his 
error rates 'decreased*. " ') .."'.>,■, 

" " ■ •■•*' ■ -'i ■ -,• • .- . ■ 

3. Ooufl B . began Sullivan Book I on 10/19/71 with a correct responding 
rate of *i.5 letters per minute. His error rate was .35 letters per minute. 
At terMf^^tlon he was wbt^klng in Book 7 with a correct rate of 8.3 letters 
per minute arid an erfbr rSte of .2 lettdPs per minute. Doug star tml in 
Suppes Nath Book 1 6n 9/21/71 with Inltiitfl rates of 4.6 numbers correct per 
minute and .3 errors per minute. At termination Doug was working on Sullivan 
Nath Book l» (Hultipi ie^.tion^ at 'a corriidi responding rate of 5.3 and an error 
rate of .00. = At the end of the school year Doug was working on basic 
multiplication and dlvlsloiv facts. The* SRA reading program was siterted on w 
1/'II/7I with Doug In Book A' and his I n^t'N^r correct read Ing^ rate was 56npier:i 
minute. His error rate was 6 per minute*.' 'At: termination he was reading ;:'< 
63 correct words per minute, with 0 errors in Book D. Doug's correct rate 
trends continued to rise with- an Increase In iMterial difficulty, white his 
error rates* decfr^s«d. ' v 

'•■ ' •^■»'^. ... , . : . 

"'f' ■ ■ . .•, ;t • . .. • •■ ' ■:, ■ 
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4. Clara M . began Sullivan Book I A on 10/5/71 with a correct responding 
rate o^ 3.0 letters per minute. Her error rate was .14 letters per minute. At 
termination siie was worlcing in Boole 9 with a correct rate of 8.6 letters per minute 
and an error rate of .15 letters per minute. Clara started in Suppes Hath Boole 1 
on 9/28/71 with an initial rate of 4.1 numbers correct per minute, and an error 
rate of .1 per minute. At termination she was on the latter part of Book 2 
responding at a $.0 per minute correct rate and a .04 error rate. At the end of 
the school year Clara was working on basic multiplication and division facts. 
Clara's correct rate tremis continued to rise with an increase in material 
difficulty, vrfiile her error rates decreased. The SltA reading program was 
. stfPted on 1/11/71 with Clara in Book A and her initial correct reading 
rate was 49 per minute. Her error rate was 7 per minute. At termination 
she was reading 71 correct words per minute, with 0 errors in Book D. 

5* Gary W . began Sullivan Book 2 on 9/28/70 with a correct 
responding rate of. 5.0 letters per minute. His error rate was .34 
letters per minute. At teno'Ination he was working on Book 10 with a 
correct rate of 8.6 letters per minute and an error rate of .08 letters 
per minute. Gary started in Suppes Math Book 1 on 9/24/70 with an initial 
rate of 4.8 numbers correct per minute, and a .1 error rate per minute. 
At termination Gary was working on Sullivan Math Book 4 (rbiiti plication) 
at a correct esponding rate of 6.2 and an error rate of .03. At the end 
of the school year Gary was working on basic multiplication and division 
facts.. . The SRA Reading program was started on 1/11/71 with Gary in Book A 
and his. initial correct reading rate was 67 per minute. His error rate 
was 4 per minute. At termination he was reading '82 correct words per 
minute, with 0 errors In Book E. Gary'^s correct rate trends continued to 
rise wi th an -increase in material difficulty, while his error rates 
decreased. 

6. Itobert M. beflan Su41ivan Book I on 2/17/7) at a correct Write- '., 
letter responding rate of 7.0 letters per minute. His error rate was .2 
letters per minute. At termination he was working on Book 10 with a correct 
rate of 8.5 letters per minute and an error rate of .06 letters per minute. 
Itobert started Suppes Hath Book K on 1/28/70 at initial rates of 

8 numbers correct per minute and .17 errors per minute. At termination, 
he was in Sullivan Book 4 and responding at a 5.5 per minute correct 
rate with a .06 error rate. His imiltipl ication and division skills were 
at grade level at the termination of this project. The SRA reading 
program was started on 2/25/71 with itobert In Book A and his Initial 
correct reading rate was 45 per minute. His error rate was 3 per minute. 
At t^/mlnatlon he was reading 100 correct words per minute, with 0 errors 
in Book F. Robert $ correct rate tremis continued to rise with an increase 
in material difficulty, while his error rates decreased. 

7. Grfegg E . began SulHvan Book lA on 2/25/71 with a correct Write-letter 
responding rate of 7.0 letters per minute. His error rate was .48 letters 
per minute. At termination he was working in Book 8 with a correct rate of 
6.0 letters per minute and an error rate of .15 letters per minute. Gregg 
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started Suppes Hath Book I on 1/28/70 at initial rates of 8 nunibers correct 
per minute and .2 errors per minute. At terininatiOn he was Irt'Sullivan 
Boole It, responding at a 5 p<er minuti correct rate and a .06 error rate/' 
His multiplication and dtVlsion sk.it1s were at grade level and re-entry into 
a regular classroom situation was projected for fall term. The SRA reading 
program was started 2/25/70 with Gregg In Book A and his initial correct 
reading rate was 55 per minute. His error rate was 5 per minute. At termlna* 
t Ion Gregg was reading 70 correct words per minute, with 1.1 errors in 
Book F. Gregg's correct rate trends continued to rise with an increase 
in material difficulty, while' his error rates decreaised.. 

8. Betty H . began Sullivan Book I A on 2/2/70 with a correct Write-letter 
responding rate of 2.5 letters per minute. Her error rate was .35 letters 
per minute. At termination she was working In Book 5 with a correct 
rate of 4.0 letteri^ per minute. At termination she was correctly reading 
40 word,s per .minute with 1. 5 . errors per minute. Betty 'star'tl^d Suppes Math 
Book I on 2/2/7d at initial rates of 5 numbers "correct per minute and i.k 
errors per minute. At tci^inistion she, v^as l^'Sufllvan Book H r'espondlng at 
a 5.,per miriiite;.TOr/ect riate and a 0 error rat^ Her multiplication Sand 

dlvmoft"sklf Is are'at grade level . " ' ■ ' \ 

•Ji" t.i^j : ' • ifrt ' iTi "Vi ■ I ,, .,:r ■ •..(.,. ... 

g.'^ TOfVce ^: ;"star'{ed •Vri- tu'fltfes Math Bijok ^on' 9/24/70 at' ihltl'^l 
rate of^TTiMrrect pey i^^^ errors'. At t^rml^natlon he wis "i 

working on thie Tatter part of ^k 2 and was resp<)'ndlng at a 6.7 per itiilnyte 
correct rate with a .01 error rate. Clarence began the SRA Readlii'g ' ' ' 
program on 1/11/71 in Book A wi.th an Initial correct; reading rate of 31 
words per minute and an er^HbV Va'te of 4 ,t«»rds per nirnute. At termfrti^t'ton 
Clarence was reading 43 cbyfiecFwords pier minute with 'i 1.5 error rate 
In Book C. ■ ■ ' • ■■ ■ ■ 

10. Ron S. began Sullivan Book I on 10/14/70 With 'ai correct Write- 
letter responding rate of 2.1 letters per mlnut^ei His ?rror fate was 

.07 letters per minute. At termination Ron wis 'working in Book 3 with a ' ' 
correct rate of 4.1 letters per minute and an error fate of .03 letters 
per mfni^te. Ron started in Suppes Hath Boole I, on 9/29/70 at Initial, r^tes 
of 2.0 numbers correct per minute and JlS efrofs per minute. At-teni^tloit 
he was *^rkrr.g on t,he jlatter part of Book 2 'was fesponding at a 7.2 ' ' 
per mljnute ccfiresc^ i;al|o,jW|jth''a .01 error rate! "fton began the SRA fading' ' 
prpgijam on Vl'l/yi l.n |bqk |^.with an 'Initial correct reading rate'of 4l ' 
wor^^ per minute 'and an error'rat'e of 6 viords per minute. At tefiAt'iiation 
Ron was reading 52 correct viords pef ml!nute with a 1.7 error rate in 
Book C. ■' • ' '■ ■ • ' 

11. Alfred B . began the Su,n'}Vah 'pre-readef on 1/8/71 with a , 
correct Write-letter responding rate of 3-8 letters per minute. ''Alfred*s 
error rfte.was .12 letters per minute. At termination Alfred , was, working ., 
In Boolii 3 with a cpfrect rate of 6.'1 letters per minute and afl dJiro'^ . jilite ' 
of .04 letters ijer^j^mjnute..', Alfred stariisd in Suppes Math 'oii ' 
9/24/7Q, at InUfa^^ rates of 4.1 numbers correct per minutf , 'iiijd" .T7''erf6fi ' 
per minute. At termfnatlbn he was working on the latter part of' ' 

Book 2 and was responding at a 5.2 per minute correct rate with a .02 

t "i 

r 
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error rate. The SRA reading program was started on 1/11/71 with Alfred 
in Book A. He had an initial correct reading rate of 32 words per minute 
with an error rate of 2 words per minute. At termination Alfred was 
reading 48 correct words per minute, with 0 errors in Boole 6. 

12. CoeN. started in Suppes Math Boole K on 9/2V70 at Initial 
rates qt 3«0 correct per minute, and A errors per minute. At termination 
Coe VIS in Book 2 and was responding at a 5*1 per minute correct rate 
with « «05 error rate. Coe began the SHA reading program on 1/11/71 
in Book A with an initial correct reading rate of 28 words per minute 
and an error rate of 6 words per minute. At termination Coe was reading 
39 correct words per minute with a 0 error rate in Book B. 

t3t Oebbie S .. began Sullivan Book lA on 1/V71 with a correct 
Write- letter responding rate of 3.0 letters per minute. Her error rate 
was .12 letters per minute. At termination Debbie was working In Book 2 
with a correct rate of 3«5 letters per minute and an error rate of .Oil 
letters per minute. Debbie's Initial Sullivan reading rate was 55 
correct words per minute with 2 errors per minute. At termination she %#as 
correctly reading 45 words per minute with 0 errors per minute. Debbie 
started Suppes Hath Book K on 1/26/70 at initial rates of 4 numbers correct 
per minute and .04 errors per minute. At termination babble was. in 
Sullivan Hath Book 4 respomiing at a 3 per minute correct rate and a 
.04 error rate. 

14. Jackie S . began Sullivan Book lA on 1/4/71 with a correct 
Write-lftter responding rate of 4.5 letters per minute. Her error rate 
was .2 letters per minute* At termination Jackie was working In Book 3 with 
a correct rate of 3.0 letters per minute and an error rate of .15 letters 
per minute. Jackie started Suppes Hath Book K on 9/23/70 at initial rates 
of 3 numbers correct per minute and .2 errors per minute. At termination 
Jackie was In the latter part of Book 2 responding at a 2.5 per minute 
correct rate and a 0 error rate. 

15* Bobby R . began Sullivan Book (A. on 1/4/71 with a correct Write*1etter 
responding rate of 3*5 letters per mihytie. Bobby's error rate was .1 
letters per minute. At terinlnatlbn he was working in Book 3 with a correct 
rate of 5*5 letters p^r minute acid an error rate of 0 letters per mlncite. 
Bobby's Initial Sullivan reading'rate was' 40 correct words per minute with 
0 errors per minute. At termination he was correctly reading 55 words per 
minute with 0 errors per minute. Bobby started Suppes Hath Book K on 
1/26/70 at Initial rates of 3 numbers correct per minute and .2 errors 
per minute. At termination he was in the latter half of Suppes Book 2 
responding at a 3 per minute correct rate and a .05 error rate. 

Ju|»e H. began Sullivan Book lA on 1/4/71 with a correct Write-letter 
responding rate of 3*0 letters per minute. Her error rate was .15 
letters per minute. At termination Julie was working In Book 3 with a 
correct rate of 4.0 letters per minute and an error rate of .05 letters 
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per minute. Julie's initial Sullivan oral reading rate was kS words per 
minute correct, witli 3 errors. At termination slie was reading correctly 50 

VS/fLK'' ° J""® Suppes H8.th Boole I on 

10/12/70 at an initial rate of 3 numbers correct per minute with .2 
errors per minute. At termination she was In the latter half of Boole 2 
responding at a 3 per minute correct rate and a 0 error rate. 

'7. .tobftrt B. began Sullivan Boole I A on 1/V7I with a correct Write- letter 
responding rate of 3.5 letters per minute, itobert's error rate was .05 
letters per Minute. At termination he was worlelng In Boole 3 with a correct 
rate of 5.5 letters per minute and an error rate of .02 letters per 
minute. Robert's Initial Sullivan reading rate was kO correct words 
per minute with 0 errors per minute. Itobert started Suppes Hath Book K 
3/23/70 at Initial rates of 3 numbers correct per minute and .16 
errors per minute. At termination he was In the latter half of Suppes 
Bbole 2 responding at a 4 per minute correct rate and, a .Ok error rate. 

Aryel M. started Suppes Hath Book K on 9/2,1/70 at initial rates 
of 2.«Kfttifflbers corrett per minute and .12 tirrorn per. minute. At ter-^ 
minatlon he was In the latter half of Suppes Book 2 r^sppndlnc at a *.l 
peir^^fnimite correct r^te and^ia .05 error rate. 

19. Patrick C. started In Suppes Hath Book K on 9/24/70 at Initial rates 

of 1.5 correct per minute, and .15 errors per minute. At termination 

Patrick was In Book 2 and was responding at a 3.5 per minute correct rate 

with a .05 error rate. Patrick began the SRA reading program on I/II/7I 

in Book A with an Initial correct reading rate of 30 words per minute. 

At termination Patrick was reading 46 correct words per minute with a 2 
error rate In Book B. 

20. Juanlta A. began Sullivan Book lA on 1/4/71 with a correct 
Write- letter responding rate of 40 letters per minute. Juanlta's error 
rate was .12 letters per minute. At termination she was working In Book 2 
with a correct rate of 2.5 letters per minute and an error rate of 0 
letters per minute. Juanlta's initial Sullivan reading rate was 24 
correct words per minute with 3 errors per minute. At termination she 

was correctly reading 30 words per minute with 0 errors per minute. Juanlta 
started Suppes Hath Book K on 9/28/70 at initial rates of .7 numbers 
correct per minute and .4 errors per minute. At termination she 
was in the latter half of Suppes Book 2 responding at a 5-5 per minute 
correct rate and a 0 error rate. 

21. SteveJ[. began Sullivan Book I A on 3/15/71 with a correct 
Write- letter responding rate of 3.2 letters per minute. Steve's error 
rate was 1.6 letters per minute. At termination he was working in Book 2 
with a correct rate of 4.1 letters per minute and an error rate of 0 
letters per minute. Steve's initial Sullivan reading rate was 27 correct 
words per minute with 5 errors per minute. At termination he was 
correctly reading 36 words per minute with 2 errors per minute. Steve 
started Suppes Hath Book K on 10/26/70 at Initial rates of 2.3 numbers 
correct per minute ard .17 errors per minute. At termination he was In the 
latter half of Suppes Book 2 responding at a 5.1 per minute correct rite 
and a .02 error rate. 
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22. Seorgene began Sullivan Book I A on I A/71 with a correct 
Write-letter responding rate of 2*3 letters per minute* Georgene's error 
rate was .06 letters per minute. At termination she was woricing In Booic I 
with a correct rate of kO letters per minute and an efror rate of 0 
letters per minute. Georgene^s Initial Sullivan reading rate was 18 
correct words per minute with 8 errors per mimite. At termination she was 
correctly reading 31 v#ords per minute with 1 error per minute. Georgene 
started Suppes Math Boole K on 2/2/70 at initial rates of 1.3 numbers 
correct per minute and .12 errors per minute. At termination she was in 
the latter half of Suppes Boole 2 responding at a 2.1 per minute correct 
rate and a .03 error rate. 

23. Gary W . began Sullivan Boole lA on 1/V71 with a correct Write- 

letter responding rate of 3.5 letters per minute. Gary's error rate was .25 
letters per minute. At ^-crminatlon he was working in Book 2 with a 
correct rste of ^.1 tetters per minute and an error rate of .07 letters 
per minutte* Gary's initial SuTtTvan reading rate was 23 correct words 
per mlinitewith 6 effors per minute. At termination he Was correctly 
reading k\ words per minute with 2 errors per minute. Gary started Suf^s 
Math Book K on 9/21/70 at an initial rate of 1.2 numbers correct per minute 
and e)rrors per minute. ' At termination he was In the latter half of 
Suppes Bbbk 2 responding at a 3.6 per minute correct rate and a .Ok 
error 'rate. . f . 
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DISCUSSION AND CONCLUSIONS 



f tasults 

The results presented in the preceding section enable us to evaluate the 
effectiveness of three important instructional objectives of the Tacoma 
Project: the systematic arrangement of instructional cues in order to promote 
efficient development of academic skills and to establish a replicable program; 
the use of contingency management; and the (measurement of performance which 
is based on continuous collection and examination of data. Data relating 
to the second and third objectives provide direct evidence of the Tacoma 
^Project's effectiveness in significantly changing stiKlent academic behavior; 
ddta concerning the first objective yield indirect evidence of success. 

Evgluatton of systematic arrangeit^ts of instructional cues. The comparisons 
of student performaftce in reading, spelling, and matH on the WRAT pre- and 
'(M>sttests shoM that the experimental classes made significant academic growth 
]p the two subject areas (reading and math) «4iich had been programmed to 
l»i^ide a systematic arrangement of instructional cues. More direct evidence of 
tne effectiveness of the progr^mied materials was the consistently low rate of 
error responses made in material which was increasing in complexity. Students* 
achievenent of errorless learning was frequently shown on the graphs; students 
who achieved errorless learning were usually able to maintain it. 

Evaluation of contingency management . Comparisons of students' performance 
during baseline conditions and after interventicm show that students made « 
significant decreases in error responses fol lowing* the implementation of 
reinforcement contingencies. 

Evaluation of measurew^t procedures. Con^^arisons of morning and afternoon 
performance in Suppes math, of session one and session two in Sullivan programmed 
reading^ and of performance in Suppes Hath Bootes I and 2 provide a comprehensive 
analysis of student performance, the information for which would not have 
been furnished by any method other than continuous measurenent. For Instance, the 
SiilUvan graphs revealed that students in the Tacoma Project performed as well 
during the second half of the period as they did during the first half— information 
that contradicts some conventional notions about students' fatigue and short 
attention spans. 

Discussion 

In the Tacoma Project, investigators applied the techniques of precision 
teaching in classrooms for children who had been labeled mentafly retarded. 
USese techniques include: systmiatic arrangement of instructional cues, the 
technology of prograimned learning, careful management of reinforcement contin- 
gencies, and accurate, continuous measuranent of performance in order to evaluate 
the total rrtstryctional process. The Project has shown that such instruction 
made a significant difference in students* academic performance. IndMd, it has 
clearly demonstrated that this particular population of students was capable of 
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exceeding society's expectations, }.e«,a hi^ percentage of the students 

were ready to be transferred to regular classes after their year *s. experience 
in a program of systematic intervention. 

' Although the discussion so far has concerned improved student performance, 
tim investigators have little doubt that the techniques u^^d in the Project 
enabled the teachers to become more efficient and effect!'^ IH their wbrlc. 
The behavior of a child in a classroom is controlled by the '<^nt ingencies 
operating in that environment; the child in turn operates on the environment to 
bring about gratifying events. The student toiov^s, for instance, that if he 
completes his math he^'^can go outside for receis, but that if he often Jumps 
out of his s^it during math, he cannot. The teacher who consciously manages the 
contingencfosr of the environment*^'- the events that are antecedent and consequent 
to l)ehdvior and that influence it**can modify student behaviors, thereby in* 
creasing the fute of deslcable ones diminishing or ext inguishing/i^id€isirable 
ones. By pinpointing behaviors, by cdntinuously measuring their occufl^ence, by 
charting and analyzing dtfta concerning those behaviors, the teacher is able to 
assess the effect iveness^f his contingency managimient. it is through the use of 
these techniques that a teacher can malos objective educational decisions and be 
freed from reliance on hunches, jesses, and other subjective, possibly in- 
accurate. Judgments about a student's progress. In classes for children witYi 
academic and social response deficits— chi Idren who already bear labels concerning 
their expected performance*-such objtetivity is especially important. 

It is not surprising that a systeoptic application of principles of rein- 
forcement Would result ifr^ incrciitied anemic aclVievement. This'ltds been ^' 
demonstrated in many stud^i'es. Tlie significance of this study sti^ from the 
attention to all details involved in the application of this principle in the natural 
setting, the almost infinite number of decisions which are required of the teacher 
to insure that each child'i^ y^<^i\riQa:Jti^i?J||9[tructiondl program and .in. ev^l ronment 
for learnirt^^that is best stirited to H^fin. '^f^rther, for the sake of r^fl^tiiMi, : 
a very complete description -of -th^B? prc^edures involved throug^ut tiUs f^^*'ff^}u6e4^ 

Although the success of <iOhtFnl|ency management is graphically demonstrated 
by the Taccma Project, the stoOi^ 6r the project was not limited to the practice 
of such manageiiie^t by experimentei^ in a special class. It included the oontin* 
uous training 'tUf regular classroonri teachers who learned to use the procedures of 
continuous recording, charting and analysis of data in addition to the prihciples 
of contingency management and the application of such principles in their 
classrooms. 

The ultimate aim of the teacher who manipulates contingencies is to build 
and strengthert in children those behaviors thai are ;jppropriate to the 
classroom. -Among such behaviors are those that wilt eventually give the child 
the slcills to manage his own envirofmient. Teaching self^management sicills 
Is, therefore, an important part of the strat^y of contingency management* 'the 
child in the example we mentioned earl ler-^'^the child who knows that if he worlcs 
on his math he can earn recess** is the one who is to some extent cbhtrollinif' ' 
^^is educational environment, and he can woric as the teacher's partner in 
establishing the conditions under which he learns. The teacher who malces 
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decisions which enhance a student's seif^management skiiis knows that an un* 
desirable behavior can be eiiminated simply by strengthening a desirable behavior 
that is incompatibie with it. He knows* too, that the selection of appropriate 
cues which evoke the desired behavior is required. Finaiiy* he knows that a 
reiativeiy minor modification of an environment can bring about a iarge improve- 
ment in performance. With this knowledge* the teacher can arrange conditions so 
that each child learns at his optimum pace* The experimenters believe that 
such conditions were amply demonstrated in the Tacoma classrooms. 

This project also revealed that such widely used programmed materials as 
Sullivan and Suppes did produce an unwarranted rate of errors. Whether or not 
It is Indeed possible to produce error-free instructional programs-*or for that 
matter whether or not error-free instruction is necessary or desirable** 
remains an important question. The critical point here is that commercially 
prepared programs have many irregularities in format, sequence* Increments of 
Information* skill required* and response expectations* These Irregularities 
exist In spite of every effort on the part bf the teacher to supplement the 
Instruction and are the most inv>ortant sbtJirce of errors in the chlldU performance 
The analysis of correct and error rates indicated that excessive errors In 
the performance of these children did produce lower correct performance rates 
and slowed progress toward the instructional objectives. 

To summarize* the acadanic f^rformance of students as well as the efficiency 
and effectiveness of teachers can be improved through technology. A teacher 
who can use the procedures of precision teaching (precise pinpointing of' 
behaviors* continuous measurement of rates of occurrence* graphic display oif 
datu* and analysis of data) can accurately assess the effects of classroom 
variables* control them* and consequently be effective In his manipulations of 
the classroom environment. For the teacher willing to neke the commitment* 
precision teaching guarantees him the professional role of making data^based* 
functional decisions which* because of their objectivity , clearly enhance 
and protect the individuality and the capabilities of his students. 
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Ten weeks after the I97N72 school year began, David Krug made, a site visit 
to the Tacoma School District for three reasons: . to gather data for the/ 
follow-up study; to determine Informally teachers' opinions of the acad^ic and 
social progress of the eight hroject students who were placed in regular 
classes; and to determine to what extent the experimental xiassrooni teacke'rs 
Were still using precision 'teaching techniques they had been tralried to use during 
the two years of the l^roject/ 

Follow*up. Results obtained from follow-up tests'^-which evaluate students' 
ability to generalize academic gains they have made in the experimental condition 
to other settings**will be described In detail in the follow-up report. 

Informal evaluation. In; informal talks, the teachers who are now working with 
students transferred from the experimental classes unanimously made favorable 
coNiments . about students' behavior and academic performance. For ex^le, one 
sixth grMe teacher, vdio has two of the boys in his classroom, said: "Greg 
and Bob are holding their own academically. In fact, in multiplication they 
^.are i|head of the rest of the class. They present rio problems behavioral ly." . 
Anothfltr teabher said about the student in her class: "No prbblem, Clara is 
doing ^wfe^.'sre^tJ" TKese comments were typical of t^ie respoh^es from all the 
teachers ifntei^viewed/ Such informal reactions are not presented ^as proof that 
students* academic and behavioral gains in performance, achlevad'ln the 
experimental classes, have been generalized and maintained in other settings* 
That inforflbt ion Will have to cpme' from the tests to be adnjinlstered. tlSU. year. 
However, the observations and" anecdote I Information are cited} to sKdw tA^t 
student adjustment'*-as perceived by* the students' teach^rs**has so far b^en 
unreserved s,uccesi. 

Precision' teaching techniques . The two ^perimental classroom teadiers from 
the Tacoma S(thtK>l District were Mary O'Leary and Susan Solf . * Mary O'Leary Is 
continuin^^ to tfskch in a self*cbntained Special Education classroom and Is ' 
training student teachers In the' procedures and techniques pf precision 
teaching* In addition, she is sharing 'her expertise with the other Special 
Education teachers in her school building. Susan Soli !s working with the 
Tacoma School District's Special Education Administration staff as a traJning 
consultant to Special Education teachers. In this capacity she is training 
teachers to use precision teaching procedures and techniques. 

This initial follow-up site visit suggests three tentative conclusions: 

1. Students have been able to maintain the gains they made in the experiiMntal 
condition and to transfer these gains to new settings. 

2. Students have also been able to generalize to new settings the behavioral 
improvements they achieved In the experimental condition. 

3* The Tacoma School District Administration is using productively the 

training and experience gained by the experimental classroom teachers during 
the Project's two years. 
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APPENDIX A 

SUNHARIES OF INDIVIDUAL SKILLS ACQUISITION 



Entering Behaviors 

I. Say Letters (Dlstar) 
Could recognize: 



Robert M 
Greg E 
Betty H 
Gary M 
Clara M 
Doug B 

June T 
Robert D 

Clarence F 


ail letters 

a,b,c,d,e,f ,h,k,l ,m,p,r,t,w 

a,b,c,d,e,f ,m,s,t,y 

all letters 

all letters 

a,u,d,e,f ,g,i ,k,l ,m, 

p,r,s,c,u,w,y 

all fetters 

a,b,c,d,e,f i ,1 ,m, 

o,s,t,y,2 

a,b,c,d,ej ,J,q,t ,w,x,y,2 


iXUfff d 


a,b,c,d,e,f ,g,k,m,r,s, t ,x 


Arvel M 
Alfred B 

Coe U 


s»f id,r,m,e,b 

h,n,u,s,o,c,f,a,i,r,t,gJ 

m,d,e 

hin,s,o,c,f,a,i,tJ,m,e,e,o 


Bobby R 




Julie H 
Gary V/ 


all letters 


Julie U 




Jackie S 




Juanita A 




Debbie 3 





Behaviors at Termination 

Say letters (Oistar) 
Could recognize: 

all letters 
alt letters 

all letters 
all letters 
all letters 

all letters 
all letters 

all letters 

m,d,aiSie,f ,r, i ,c,o,n,a>h, 
u»b,j,o,w,x,y,2 
ni,d,s,a,e,f ,r, i ,t,ahu, gon 
I»w,k,u,p,b,y,s,c,d,k,y 
m,d,u,s,e,f ,r, i ,t ,h,u,c,o,n 

all letters 

m,d,a,s,f ,r , i ,c,o,n,t ,a,h,u 
gil,w,i ,k,o,u,e 
m,a,c,f ,r,i ,d,c,o,n,t,h,u, 
g,l ,w,k,p,u,t,o,y,w,2 
all letters 

m,a,s,e,f ,t ,n,t,h,u»g,0|W, 
k,o,u,p,y, 

ni,c,o,n,i,t,a,h,u,g,l,w,l, 
k,u,p,e,b 

fnfaiS,e,r, i ,d,f ,c,o,n,t ,h, 
w.9JiW,y,x,p,z,k,m,u 
m,a,s,e,f ,d,r, i ,c,o,n,t,h, 
u,g,I ,vi/,o,p 

m,a,s,e,f ,d,r, I ,c,o,n,t,h,u, 
gJ,w,k,i,o,p,yJ,x,z 



REAOIilG SKILLS 



Entering Behaviours 


Behaviours at Terminat ion 


II. Say Sounds (Distar . 


II* Say Sounds (Distar) 


Could recognize: 


Could recognize: 


Robert t1 


a,b,c,d,e,h,k,l,m,p, 


al 1 sounds 




r,s,t,y,z 




Greg E 


d,b,e,k J f^fSft 


all sounds 


Betty H 


aieyiTiyS 


ail sounds 


Gary \f 


a,b,c,d,e,f ,m,y,s,t 


all sounds 


Clara M 


a,b,d,e,h,k,l ,m,n,p, 


all sounds 




r,s,t,2 




Doug B 


a,b,m,p 


all sounds 


June T 


a,b,d,e,h,k,l ,m,p,r, 


all sounds 




s,t,w 




Robert D 


a,d,f ,h,m,s,t 


all sounds 


Clarence F 


ft^ ^ * 
wj,D,d,t 


m,d,a,s,e,f,r|i |t ,con,ahug Jus 


Ron S 




k.o.u.b. 1 •<] .viiXiViZ 


afb,c,g,fn,s 


ffiyd.s.a.e.f .r, i ,tdhu> gon, 1 .v^. 


Arvet H 




cup,b,y,s,c,d,k,y 


m,e,d,d,f >c, 


m,d,atS,e^f ,r, i ,th,hu,one 


Fred B 


e,d,o,hJ ,c,n,t,s,f 


all sounds 


Coe ri 


n,p,d,h,w,o J ,9,n,t, 


a,d,a,s,f ,r,I,c,o,n,t,a,h,u,g,l , 




the,f ,a,u 


vv, i ,k,o,u,e 


Bobby R 




macfrl ,con^th,u,gl ,w,k,p,u, j ,x, 


Julie H 




o»you |W»z 




all sounds 


Gary \/ 




mase,fri ,n,th,u,gl ,w,k,o,u,p,y, j 


Julie U 




mase,d,r,l,c,o,h,u,g,l,u,s,i ,k,b 


Jaclcie S 




yJfUfP 




mase,rid,f ,con,th,a,gl ,w,y,x,o,z, 






k^m,u 


Juanfta A 




mase,f ,d.,r, i ,con,th,u,gl ,w,up 


Debbie S 




mase^fr , i |d,con,th^u,g| 9W,lc,0|U,p 






y,j,x,ou,z 



READING 

Entering Behaviors 

: 

V/rite Letters Correct 
(Sullivan) BK# Rate 



f Robert M lA 7.0 

I Greg E IA 7.0 

I Betty H IA 9.0 

f Gary W 2 5.O 

I Clara M IA 3.0 

f Doug B I 1^.5 

I June T I 5.0 

I Robert 0 IA i^.O 

I Clarence F IA 5.O 

I Ron SI 2.1 

I Arvel M no rates 

Fred B IA 3.8 

Coe N IA 3.0 

Bobby R IA 3.5 

Julie H IA 3.0 

Gary W IA 2.3 

Julie W lA /».5 

Jackie S IA I1.5 

Juanita A IA 2.7 

Debbie S IA 3.0 



SKILLS 

Behaviors at Termination 



Error 


V/rite Letters 


Correct 


V» 1 1 VI 


Rate 


(Sullivan) Blc# 


Rate 




.2 


10 


8 q 




.t»8 


8 


6.1 


• ' ^ 


.06 




5.2 


.05 


.34 


10 


6.1 


.08 


.14 


8 


8.6 


.15 


.35 


7 


8.3 


.2 


.1 


7 


5.5 


.02 


.9 


3 


5.1 


.06 


.12 


2 


A. 5 


.13 


.07 


3 


it.l 


.03 


.12 


3 


6.1 


.Ok 


.05 


1 


2.9 


.06 


.10 


3 


5.5 


.00 


.15 


3 


4.0 


.05 


.06 


1 


k.O 


.00 


.9 


2 


k.O 


.05 


.15 


3 


8.0 


.00 


.2 


2 


1.0 


.00 


.12 


2 


3.5 


.Olt 



erJc 



READING SKILLS 



I 



Entering Behaviors 








urai Keaoing 


Correct 


Error 




^duiiivan; BKf 


Rate 


Rate 


nODer^ 11 


1 A 

i A 


55 


3 




1 A 

lA 


55 


6 


vetty n 


1 A 

lA 


35 


4 


Gary U 


2 


45 


2 


Clara H 


lA 


50 


1 


Doug B 


1 


40 


2 


June T 


1 


2k 


3 


Robert 0 


lA 


&5 


0 


Clarence F 


lA 


25 


0 


Ron S 


1 


35 


0 


Arvel M 


no rates 






Fred B 


iA 


35 


0 


Coe N 


lA 


20 


0 


Bobby R 


IA 


40 


0 


Julie H 


IA 


45 


3 


Gary W 


IA 


18 


8 


Julie W 


no rates 






Jackie S 


no rates 






Juanita A 


no rates 






Debbie S 


IA 


55 


2 



Behaviors at Termination 



Oral Reading 
(Sullivan) QK0 

10 

8 

5 

10 

8 

7 

7 

3 

2 

3 

3 
I 
3 
3 

lA 



Correct 
Rate 

130 

95 

65 

85 

95 

65 

50 

120 

40 

45 

55 
40 
55 
60 
31 



45 



Error 
Rate 

0 
2 
0 
0 
0 
0 
0 
0 
0 
0 

0 
0 
0 
0 

I 



READING SKILLS 



Entering Behaviors 



Behaviors at Termination 



0 

ERIC 



Oral Reading 
(SRA) BK# 



Correct Error Oral Reading Correct Error 
Rate Rate (SRA) BK # Rate Rate 



Robert M 


A 


hS 


5 


F- 


3reg E 


B 


61 


10 


E 


Betty H 


A 


55 


2 


E 


Gary W 


A 


67 


4 


D 


Clara H 


A 


49 


7 


0 


Doug B 


A 


56 


6 


C 


June T 


A 


40 


5 


C 


Robert D 


A 


63 


3 


C 


Clarence F 


A 


31 


4 


B 


Ron S 


A 


41 


6 


B 


Arvel N 


no rates 






Fred B 


A 


32 


2 


B 


Coe N 


A 


28 


6 


B 


Bobby R 


A 


45 


2 


C 


Julie H 


no rates 








Gary W 


A 


33 


5 


B 


Julie W 


A 


40 


4 


C 


Jackie S 


no rates 








Juanita A 


no rates 








Debbie S 


A 


50 


4 


C 



108 
72 
70 
82 
71 
63 
51 
96 
43 
52 

48 
39 
95 

75 
80 



no 



0 

4 

0 
0 
0 
0 
0 
0 
0 
0 

0 
0 
0 

2 
0 



MATH SKILLS CHECK LIST (95% Accuracy) 



•lame Robert S 



Skill Presentation Entering Behaviours At 

Order Behaviours Termination 

" ■ ' ■- ■ ^ ■ ■ ■ ■ . ■ ■ ■ ,1 a ■ ■ ■■ I .. — ■ I t mt ■ ■■ ■ ■ ■ . ^. ■ ■■■II. . .. .1 

Book K: 



I • Bigger -* Smai ler 



2. if's to two 



3. Larger - Shorter 



#•$ to three 



5* Hatching Shapes 



6. #'s to five 



7* Counting Pennies 



Book 1: 



1. Union of Sets 



2. Adding If's 1-5 



5. Adding #'s 6-10 



6* Tens and ones 



3. Difference of Sets 



4. Subtracting #'s ^ 



ERIC 



7. number Sentences 



8. Geometry: 

a. Measurement ^ 
O ' b* Construction 



X 



(lath Skills Checklist (95% Accuracy) 



Robert S. 



ft 

I: 



Ski 1 1 Presentat ion 
Order 


1*1 • III l%J 

Dehaviours 


Termination 


K Addition of #'s 




X 


2. Difference of Sets 




X 


3. Subtraction of 0's 




X 


k. Add & Sub 


- — 


X 


5* Tens & On^^ 




X 


6. #'s 11 to 19 




X 


7. lOO's lO's 
and ones 




X 


8. Less than 




X 


9. Regrouping In 
Addition 




X 



10. Geometry 



11. 


Regrouping in Sub 


12. 


Fractions 


13. 


Equations 




Multipl ication 


15. 


Area 


16. 


Wbrd Problems 



ERIC 



i 



ERIC 



MATH SKILLS CHECK LIST 


(S5Z Accuracy) 


Name June T. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


Book K: 


Bigger - Siraller 


X 


X 


2. /i^'s to two 


X 


X 


3. Larger - Shorter 


X 


X 


k. #'s to three 


X 


X 


5' Matching Shapes 


X 


X 


6. #'s to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1 : 


i. Union of Sets 


X 


X 


2. Adding #'s 1-5 


X 


X 


3. Difference of Sets 


X 


X 


4. Subtracting H's 


X 


X 


5. Adding #'s 6-10 


X 


X 


6. Tens and ones 


X 


X 


7. (lumber Sentences 




X 


8. Geometry: 

a. Measurement 

b. Construction 


X 
X 


X 
X 



Math Skills Checklist (95^ Accuracy) 




JUNE T. 




Skill Presentation 


Entering 




Behaviours At 


Order 


i}ehaviours 




Termination 


U Addition of Ps 


X 




X 


2. Difference of Sets 


X 




X 


3* Subtraction of #'s 


X 




X 


4. Add & Sub 


X 




X 


5* Tens & Ones 


X 




X 


o. f's 11 to 19 


X 


— — 


X 


7. lOO's 10's 


X 






and ones 






X 


0. Less than 


X 




X 


9. Regrouping In 
Addition 






X 


10. Geonietry 


X 




X 


II. (^grouping in Sub 






X^' 


12. Fractions 


— 




X 


13. Equations 


X 




X 


14. Multiplication 


X 




X 


15 • Area 






X 


16. tJord Problems 



I X 

ERiC 



MATH SKILLS CHECK LIST (SS% Accuracy) 


tiame itobert M. 


Skill Presentation Entering 
Order Dehaviours 


Behaviours At 
Termination 


Book K: 


1 . Bigger - Smal ler X 


X 


2. #'s to two 


X 


3. Larger - Shorter 

X 


X 


k. #'s to three 


X 


5. Matching Shapes X 


X 


6. #'s to five 


X 


7. Counting Pennies 


X 


Book 1: 


1. Union of Sets 


X 


2. Adding #'s 1-5 


X 


3. Difference of Sets 


X 


4. Subtracting 0's 


X. 


5. Adding #'s 6-10 


X 


6. Tens and ones 


X 


7. number Sentences 


X 


8. Geometry: 

a. Measurement 

b. Construction 


X 
X 



Math Skills Checklist (95^ Accuracy) 



Skin Presentation 
Order 


Entering 
Behaviours 




Behaviours At 
Terfninat ion 


U Addition of 








2. Difference of Sets 




- — 


Y 

A 


3. Subtraction of #'s 






V 

A 


4. Add S Sub 




— 


X 


5. Tens & Ones 






X 


6- #'s n to 19 






X 


7. lOO's lO's 
and ones 






X 


B. Less than 


9. Regrouping In 
Addition 






X 


I0« Geometry 






X 


II. Regrouping in Sub 






X 


12. Fractions 









13. Equations 



]'*. Multiplication 



15. Area 



16. Itord Problems 



MATH SKILLS CHECK LIST (955 Accuracy) 



llame Clarence F. 



ERIC 



Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 




Book K: 


I* Bioqer Srnaller 


X 


X 




2* ^'s to two 


X 


X 





3. Larger - Shorter 


X 


X 




A. jf's to three 


X 


X 




5« Matching Shapes 


X 


X 




6. #«s to five 


X 


X 




7. Counting Pennies 


X 


X 




Book 1: 


1. Union of Sets 


X 


X 




2. Adding #'s 1-5 


X 


X 





3. Difference of Sets 



4. Subtracting Ps 



5. Adding #'s 6-10 



6* Tens and ones^r^ 



7* ilumber Sentences 



8. Geometry: 

«• fteasurement 

b. Ccmstruction J 



Math Skills Checklist 05Z Accuracy) 



Clarence F. 



Skill Presentation 
i Order 

{ — — 


Entering 
Behaviours 


Behaviours At 
Termination 


I 

\ 1. Addition of Ps 

I 


X 


X 


! 

1 2. Difference of Sets 


X 


X 


1 

j 3. Subtraction of Ps 


X 


X 


k. Add 6 Sub 

f 




X 


1 5. Tens & Ones. 




X 


6. #•$ 11 to 19 




X 


7. lOO's lO's 
i and ones 




X 


8* Less than 


j 9* Regrouping In 
Addition 




X 


10. Geometry 


11. Regrouping in Sub 

- 






12. Fractions 






13* Equations 


14. ilultipMcation 







15* Area 



16. ttord Problems 



ERIC 



MATH SKILLS CHECK LIST (95% Accuracy) 



Ham Patrick C« 



Skin Presentation Entering Behaviours At 

Order Behaviours Termination 



Book K: 



1 • Bigger - Smat ler 


y 

A 




2. #*s to two 


V 
A 




3- Larger - Shorter 


X 




^. #'s to three 


X 




5* Matching Shapes 


X 




6. #»s to five 


X 




?• Counting Pennies 


X 




Book 1: 


) . Union of Sets 


X 




2. Adding #*s 1-5 


X 




3. Difference of Sets 


X 




4. Subtracting Ps 


X 




5. Adding #»s 6-10 


G. Tens and ones 


7. Number Sentences 


8. Geometry; 

a. Measurement 

b. Construction 



ERIC 



Math Skills Checklist (95% Accuracy) 



Skill Presentation 
Order 



K Addition of #'s 



2, Difference of Sets 



3. Subtraction of #'s 



4. Add 6 Sub 



5. Tens e Ones 



6. #*s II to 19 



7. lOO's lO's 
and ones 



Entering 
Behaviours 



Patrick C, 



Behaviours At 
Termination 



8. Less than 



9. Regrouping In 
Addition 



10. Geometry 



11. Regrouping in Sub 



12. Fractions 



«3* Equations 



I*. Multiplication 



15* Area 



16. Ubrd Problems 



MATH SKILLS CHECK LIST (95^ Accuracy) 




Ilame Robert D. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


Book K: 


1. Bigger - Smaller 


X 


X 


.2. #'s to two 


X 


X 


3. Larger - Shorter 


X 


X 


4. 0's to three 


X 


X 


S. Hatching Shapes 


X 


X 


6. #'s to five 




X 


7' Counting Pennies 




X 



Book I: 



1, 


Union of Sets 






X 


2. 


Adding #'s 1-5 






X 


3. 


Difference of Sets 






X 




Subtracting #'s 






X 


5. 


Adding #'s 6-10 






X 


6. 


Tens and ones 






X 


7. 


number Sentences 









8, Geometry; ^ 

d. Measurement ^ 
^ b. Construction ^ X 

ERIC 



Math Skills Checklist (95^ Accuracy) 



Robert 0. 



Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 




1. Addition of #'s 




X 




2. Difference of Sets 




X 




3. Subtraction of #'s 




X 




k. Add £ Sub 




X 




5. Tens 6 Ones 




X 




6. #'s It to 19 




X 




7. 100's lO's 
and ones 




y 

A 




8. Less than 




y 
A 




'9* Regrouping In 
Addition 




X 




10. Geonetry 




X 




11* Regrouping in Sub 




X 




12* Fracttons 




X 




13. Equations \ 


Multiplication 




X 




15* Area 




X 





16. Vibrd Problems 



MATH SKILLS CHECK LIST (95% Accuracy) 



Name Doug B> 



Skill Presentation Entering Behaviours At 

Behaviours Termination 

Book K: 



! 



I. Bigger - Smaller 



2. 


#'s to 


two 


X 


X 




3. 


Larger 


- Shorter 


X 


X 






if's to 


three 


X 


X 





5. Matching Shapes 



6. #'s to five 



7. Counting Pennies 



Book 1: 



1 • Union of Sets 



2. Adding Ps 1-5 



3* Difference of Sets 



i 

i 


Subtracting 0's 


X 


X 




5. 


Adding #'s 6-iO 


X 


X 




6. 


Tens and ones 


X 


X 




7. 

1 


NiMiber Sentences 




X 





I 8. Geometry: 

i a. Measurement X X 

b. Construction X X 



Math Skills Checklist (951 Accuracy) 



Doug B. 



Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


1. Addition of #'s 


X 


y 


2. Difference of Sets 




X 


3* Subtraction of If^s 




X 


k. Add S Sub 




X 


5. Tens & Ones 




X 


6. #'s II to 19 




X 


7* lOO's lO's 
and mes 




X 

• 


8. Less than 




X 


9* Regrouping in 
Addition 




X 


10. Geometry 




X 


II* Itegrouping in Sub 




X 


12. Fractions 




X 


13* Equations 


14. Multiplication 




X 


15* Area 




X 



I 16* Vtord Problems 

f 



NATN SKiaSXhSCK LIST (95% Accuracy) 


Name juanlta A. 


Skill Presentation entering 
Order Behaviours 


Behaviours At 
Termination 


Book K: 


i. Bigger - Smaller X 


X 


2. #*s to tMO X 


X 



3. Larger - Shorter 



4. #'s to three 


X 


X. 


5< Matching Shapes 


X 


X 


6. #'s to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1: 


r 

1. Union of Sets 




X 


\ ' 

,t. Adding #«s 1-5 




X 


3. Difference of Sets 




X 



4a Subtracting #*$ 



5. Adding #•$ 6*10 



6. Tent and ones 



i 7* Nun4>er Sentences 



ERIC 



8. Gaomtf7: 

b. Construction j| 



Hath Skills Checklist iS5% Accuracy) 



ikill PresenCdjtion 
Order 


Entering 
oenaviours 


Behaviours At 
Termination 


1. Addition of #*s 


' — - ■ ' 




2* Oifferance of Sfit« 

s 




X 


3« Subtraction of 




X 


4. Add & Sub 




X 


5. Tens ( Ones 




X 


6. #*s II to 19 




X 


7. lOO's lO's 
and ones 




X 


B. Less than 




X 


9* Regrouping in 
Addition 




X 


10. G^oetry 


II. Regroujjing in Sufo 


12. Fractions 


13. E^ations 


14. Hultlplication 


15. Area 



16. Wbrd Problems 



Math Skills Checklist (95% Accuracy) 

Arvel M* 



Skill Presentation Entering Behaviours At 

Order Behaviours Terminat ion 

BK-2 



1. 


Addition of #*s 




X 


2. 


Difference of Sets 




X 


3. 


Subtraction 
of #'s 




X 


4. 


Add 6 Sub 




X 


5. 


Tens 6 Ones 






6. 


#'s 11 to 19 






7. 


tOO's lO's and ones 






8. 


Less than 






9. 


{grouping In Addition 






10. 


Geometry 






n. 


Regrouping in Sub 






12. 


Fractions 






13. 


Equations 






14. 


Multiplication 







15. Area 



16. Mori Problems 



HATH SKILLS CHECK LIST (95% Accuracy) 



Name Arvel M. 



Skin Presentation Entering Behaviours At 

Order Behaviours Termination 



ERIC 



8. SeoMtry: 

a* HeasurMMt 
b. Conftruction 



Book K: 


1. Bigger - Smaller ^ 


X 




2. #•$ to two 


X 




3. Larger - Shorter jj 


X 




4. I's to three 


X 




5. Hatching Shapes ^ 


X 




6. #•$ to five 


X 




7. Counting Pennies 


X 




Book 1 : 


1. Union of Sets 


X 




2. Adding #•$ I-5 


X 




3. Difference of Sets 


X 




Subtracting #'s 


X 




5. Adding #•$ 6-10 


X 




6. Tens and ones 


X 




7* Nunber Sentences 

— y ' r 



Math Skills Checklist (95% Accuracy) 



Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


1. Addition of #'$ 


X 


X 


2. Difference of Sets 




X 


3* Subtraction 
of #*s 




X 


k. Add 6 Sub 




X 


5. Tais $ Ones 




X 


6. I's 11 to 19 




X 


7. 100's 10*s and ones 




X 


8. Less than 




X 


9. Itegrouping In Addition 




X 


10* Geometry 




. X 


IK Regrouping in Sub 




X 


12. Fractions 




X 


13* Equations 


\H. Hultiplication 




X 



15. Area 



16. Vtord Problems 



NATH SKILLS CHECK LIST (95); Accuracy) 




Name Julie H. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


Bool( K: 


i. Bigger - Smaller 


X 


X 


2. #'s to two 


X 


X 


3. Larger • Shorter 


X 


X 


k. #'s to threu 


X 


X 


5. Matching Shapes 


X 


X 


6. #>s to five 


X 


• 

X 


7. Counting Pennies 


X 


X 


Book i: 


1. Ihiion of Sets 


X 


X 


2. Adding |*s 1-5 


X 


X 



3* Difference of Sets 



k. Subtracting |U 



5. Adding I's 6-10 



6. Tens and ones 



^ 7* Number Sentences 



8. GMRietry: ^ 
i a. Neasurement » 

ERXC ^* Construction 



Math Skills Checklist {$5% Accuracy) 



Skill Presentation 
• Order 3,^.2 


Entering 
Behaviours 


Behaviours At 
Termination 




1. Addition of #*s 




X 




2. Difference of Sets 




X 




3. Subtraction 
of #»s 




X 


- 


4. Add 6 Sub 




X 




5. Tens & Ones 




A 




6. t's 11 to 19 




y 
A 




7* 100 *s lO^s and ones 




A 





8. Less than 




X 




9. Regrouping In Addition 




X 




10. Geometry 




X 




11. Regrouping in Sub 



12, Fractions 



13. 


Equations 




Multiplication 


15. 


Area 



16. Word Problems 



MATH SKILLS CHECK LIST (95» Accuracy) 



Name Jackie S. 



Skill Presentation 
Order 



Entering 
Behaviours 



Behaviours At 
Term!nat)on 



Book K: 


1 • Bigger - Smaller 


X 


X 


2, f 's to two 


X 


X 


3. Larger - Shorter 


X 


X 


#'s to three 


X 


X 


5. Hatching Shapes 


X 


X 


6. #'s to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1: 


1. Union of Sets 




X 


2. Adding #'s 1-5 


X 


X 


3. Difference of Sets 




X 


k. Subtracting I's 




X 


5. Adding #'s 6-10 




X 


6. T«)s and ones 




X 



7. Number Sentences 



8. Geometry: 

«• Measurement 
Construction 



X 
X 



I Math Skills Checklist (95% Accuracy) 



Skill Presentation 

BK.2 


Entering 
Behaviours 


Behaviours At 
Termination 


K Addition of #'s 




X 


2. Difference of Sets 




X 


3. Subtraction 
of #•$ 




X 


4. Add & Sub 




X 


5. Tens t Ones 




X 


6. #'s n to 19 




X 


7« lOO's 10's and ones 




X 



8« Less than. 



9« Regrouping tn Mditton 



10. 


Geometry 


X 


n. 


Regrouping in Sub 


X 


12. 


Fractions 


X 


13. 


Equations 




111. 


Multiplication 


X 


15. 


Area 





16. Word Problems 



MATH SKILLS CHECK LIST (95% Accuracy) 


Name '^^^'^ 


Skill Presentation Entering 
Order Behaviours 


Behaviours At 
Termination 


Book K: 


1. Bigger - Smaller ^ 


X 


2. I's to two j{ 


X 


3. Larger - Shorter ^ 


X 


k. §*% to three y^ 


X 


5« Matching Shapes y^ 


X 


6. |*s to five y^ 


X 


7. Counting Pennies y^ 


X 


Book 1: 


X 


K Union of Sets 


X 


2. Adding #'s 1-5 X 


X 


3* Difference of Sets 


X 


k. Subtracting #*s 


X 


5. Adding I's 6-10 


X 


6, Tens and ones 


X 


7* Number Sentences 


* 

X 


8. Geometry: 

a* Neasurement 


X 
X 



b« Construction 



f 



i 



Hath Skills Checklist (951 Accuracy) 




Robert B* 




Skill PfMentdtfon 

Order bK-2 


bif wcr i fly 

Bdiaviours 


DenaviOMrs mc 
Termination 




1. Addition of I's 








2« Diff^renc^ of Sets 




X 




3* Subtraction 
of 




X 




4. Add 6 Sub 




X 




5. Tens S Ones 




X 




6, #»s tl to 19 




X 




7. lOO's lO^s and ones 




X 




8. Less than 




X 




9. Regrouping In Addition 




X 




10. Geometry 




X 




11* Regrouping in Sub 




X 




t2« Fractions 




X 




13* Equations 


\k. Hultiplication 




X 





15* Area 

1 ^ 

I 16. Vford Pr^lems 



HATH SKILLS CHECK LIST {9S% Accuracy) 



Rnherf ^' 



Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


Book K: 


t. Bigger - Smaller 


X 


X 


2. #'s to two 


X 


X 


3. Larger - Shorter 


X 


X 


k, 0*s to three 


X 


X 


5. Hatching Shapes 


X 


X 


6. #'s to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1: 


1. Ik) ion of Sets 




X 


2. Adding #'s 1-5 


X 


X 


3. Difference of Sets 




X 


k. Subtract imj #*s 




X 


5. Adding l*s 6-10 




X 



6* Tens and ones 



7* Number Sentences 



8* GeoiMtry: ^ 

e. Neesurement ^ 

O b. Construction ^ 

ERIC 



! 

f 



Math Skills Checklfst ($5% Accuracy) 




Greg E. 


• 


^Ki 1 1 Presentation 
Order 

BK-2 


Entering 
Behaviours 


Behaviours At 
Term 1 nation 




1 AAA t * S A# # 1 . 
!• AOdltfOn Or f S 


X 


X 




4* III f Terence ot Mts 




X 




^. Subtract ion 
of #•$ 




X 




4. Add 6 Sub 




X 


• 


5. Tens & Ones 




X 




6. I's n to 19 




X 




7. lOO's lO's and ones 




X 




8. Less than 




X 




$. Regrouping In Addition 




X 




10. Geometry 




X 




11. Regrouping in Sub 




X 




12. Fractions 


13. E^ations 




X 




14. Multiplication 




X 




15> Area 




X 





16. Word Problems 



i 



HATH SKILLS CHECK LIST (95« Accuracy) 



Naiw e Sreo E 



Skill Presentation 
Order 


Entering 
BdtaviMirs 


Behaviours At 
Termination 


Book K: 


1 . Bigger - Sffaller 


X 


X 


2. #'s to tMO 


X 


X 


3. Larger - Shorter 


X 


X 


4. I's to three 


X 


X 


5* Matching Shapes 


X 


X 


6. I's to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1: 


1. Union of Sets 




X 


2. Adding I's 1-5 


X 


X 


3. Difference of Sets 


X 


X 


k. Subtracting I's 




X 


5. Adding I's 6-10 




X 


6. Tens and wies 




X 



7. Number Sentences 



8. Geometry : 

a. Heasurement 

b. Construction 



X 

X 



j 



HATH SKIUS CHECK LIST ($5% Accuracy) 




Name kUrmA 


Skill Presentation 
Order 


Entering 
[»ehaviours 


Behaviours At 
Termination 


Book K: 




V 
A 


y 
A 






A 


3. Urger - Shorter 




X 


4. #*$ to three 




X 


5* Matching Shspes 


X 


X 


6. #•§ to five 




X 


7* Counting Pennies 




X 


Book 1: 


1. Union of Sets 




X 


2. Adding I's t-5 


X 


X 


3* Difference of Sets 




X 


k. Subtracting #*s 




X 


5. Adding V% $*I0 




X 


6. Tens and ones 




X 



7* Number Sentences 



8. 



6eometrys 

ee NaasurMiant 

b* Construction 



I Math Skills Checklist {9S% Accuracy) Alfred B. 

Sklli Presentation Entering Behaviours At 

Order Behaviours Termination 



1. 


Addition of #'s 


X 


2. 


Difference of Sets 


X 


3. 


Subtraction of #'s 




k. 


Add $ Sub 




5. 


Tens & Ones 




6. 


#*s 11 to 19 




7. 


lOO's lO's 
and ones 




8. 


Less than 




9. 


ftegrouping In 
Addition 




10. 


Geometry 




1 1 . 


fie9rouping tn 




12. 


Fractions 




13. 


Equations 






Hut ti plication 




15. 


Area 





16. Word Problems 



I 

i 



Nath Sicilii Checklist (952 Accuracy) 




JULIE W. 


Skill Presentation 
Orter 


Entering 
Behaviours 


Beiiaviours At 
Tenninati<Mi 


I. Addition of f's 




X 


2. Olffermce of Sets 




X 


3> Subtraction or f's 




X 


4. Add » Sub 




X 


5. Tens & Ones 




y 


6. #'s 11 to 19 




X 


7. lOO's ID'S 
and ones 




X 


8. Less thm 




X 


9. Regrouping In 
Addition 


10. Geometry 




X 


11. ftegrouping in Sub 


12. Fractions 


13* E^ations 


14. Hultiplication 


IS. Area 



16. Word Problems 



ERIC 



MATH SKILLS CHECK LIST (9S« Accuracy) 




Name julie u. 


Skill Presttitatlon 


Entering 


Behaviours At 


Oriter 


Behaviours 


Termination 


Book K: 


1. Bigger - Smaller 


X 


X 


2. #'$ to tMO 




X 


3. Larger - Shorter 


X 


X 


k. #•$ to three 




X 


5. Hatching Shapes 


X 


X 


6. #'s to five 




X 


7. Cwinting Pennies 




X 


Bo6k 1: 


1. Union of Sets 




X 


2. Adding #'s 1-5 




X 


3. Difference of Sets 


k. Subtracting #'s 




X 


5. Adding I's 6-10 




X 


6. Tens and ones 




X 



?• Number Sentences 



8e Geometry: 
i e. tieesyrement 
^ b. Construction 



X 
X 



Hath Skflls Checklist ($5% Accuracy) 




Bobbie it. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


1. Addition of l*s 




X 


2. Difference of Sets 




X 


3. Subtractton of #<s 




X 


4. Add S Sub 




X 


5« Tens & Ones 




X 


6. #'s n to 19 




X 


7« lOO's lO's 
and ones 




X 


8. Less than 


9. Regrouping In 
Addition 




X 


10. GeoMtry 




X 


II. ftegrouping in Sub 


12. Fractions 



13* Equations 



14. Multiplication 



15. Ar«a 



' 16. \tor4 Problems 

ERIC 



MATH SKILLS CHECK LIST (gS* Accuracy) 



Skin Presentation 
Order 



Book K: 



I. Bigger - Smaller 



3. Larger - Shorter 
#•$ to three 



5. Matching Shapes 



6. #'s to five 



7. Counting Pennies 



Book I: 



1. Union of Sets 



2. Adding #'s 1-5 



3. Difference of Sets 



4. Subtracting #'s 

5. Adding #<s 6-10 

6. Tens and ones 



7. Number Sentences 

' 6. GMmetry: 

a. Measurement 

b. Construct iwi 



ERJC 



Entering 
Behaviours 



Name Bobble R. 



Behaviours At 
Termination 





X 
X 
X 



X 
X 



I 



Math Skills Checklist (951 Accuracy) 




Betty H. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


1. Addition of #'s 


X 


X 


2. Difference of Sets 


X 


X 


3. Subtraction of #'s 


X 


X 


4. Add & Sub 


X 


1 




X 


X 


6. II to l«i 


/. 


X 


7. lOO's lO's 
and AiMc 

ai 9%l V9 iV 9 


X 


X 


8* Less than 




X 


9* Raoraimlnfi In 

Addition 




X 


to. Geometry 




X 


II. ftegrouping in Sub 




X 


12. Fractions 


13. Equations 




X 


14. Multiplication 




X 



15. Area 



16. Wbrd Problems 

! 

6 

ERIC 



MATH SKILLS CHECK LIST (95% Accuracy) Name Bettv H. 



Skin Presentation Entering Behaviours At 

Behaviours Termination 



Book K: 



I. Bigger > Smaller 



2. |*s to two 



3. Larger - Shorter 



#»s to three 



5. Matching Shapes 


X 


X 


6. #'s to five 


X 


X 



7. Counting Pennies 



Book I: 

t. Union of Sets 



2. Adding #•$ 1-5 



3. Difference of Sets 



4. Subtracting #'s 



5. Adding jT's 6-10 


X 


X 


6. Tens and ones 


X 


X 


7< Number Sentences 




X 


0. G^Mnetry: 

a. Measur^nt 

b. Construction 


X 
X 


X 
X 




Hath Skills Checklist (95% Accuracy) 




Gary W. 


Skin Presentation 


Entering 


Behaviours At 


Order 


Behaviours 


Termination 


1. Addition of #'s 




X 


2. Difference of Sets 


3. Subtraction of #'s 




X 


4. Add 6 Sub 




X 


5. Tens & Ones 




X 


6. #'s II to 19 


7. lOO's lO's 






and ones 






6. Less tlian 


9. itegrouping in 






Addition 






10. Geometry 


II. Regrouping in Sub 


12. Fractions 



13. Equations 



Hulti plication 



IS. Area 



16. Vtord Problems 



t ERIC 



HATH SKILLS CHECK LIST (95% Accuracy) 




Name Gary W. 


Skill Presentation 
Or<ler 


Entering 
Behaviours 


Behaviours At 
Termination 


Book K: 


• • Digger * Sfnaiier 


X 


X 


t-' f $ to two 




X 


3. Larger - Shorter 




X 


4. #'s to three 




X 


5. Hatching Shapes 


X 


X 


6. #'s to five 




X 


7< Counting Pennies 




X 


Book 1: 


1. Union of Sets 




X 


2. Adding #*s 1-5 




X 


3* Difference of Sets 




X 


4. Subtracting #*s 




X 


5. Adding #'s 6-10 




X 


6. Tens and ones 




X 



?• Number Sentences 



8. 



Geometry: 

a. Meesyrement 

b. C(Mistruction 



X 
X 



Hath Ski Ms Checklist 0S% Accuracy) 



Debbie S. 



Skill Prasentdtlon 

Order 


tncer tng 
Behaviours 


Behaviours At 
Termination 


1. Addition of 0'n 




X 


2. Difference of Sets 




X 


3. Subtraction of #'s 




X 


k. Add & Sub 




X 


Tuns & An^e 

^e 1^119 W Wnv9 




X 


6. #'s II to 19 




X 


7. 100'$ lO's 




X 


8. Lesft than 




X 


9. Renrountna In 
Addition 




X 


10. Geometry 




X 


11. Regrouping in Sub 




X 


12. Fractions 




X 


13* Equations 




X 


14. Nultipl {cation 




X 


I5« Area 




X 


16. Word Prob]m% 




X 



HATH SKILLS CHECK LIST (95% Accuracy) 




Name Debbie S. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Teraination 


Book K: 


I* Bigger - Smaller 


*\ 


w 
A 


2. #*s to tMO 


X 


V 
A 


3. Larger - Shorter 


X 


X 


4. #*s to three 


X 


X 


5* fetching Shapes 


X 


X 


6. I*s to five 


X 


X 


7* Counting Pennies 


X 


* X 


Book 1:, 


1. Union, of Sets 




X 


2. Adding Ps 1*5 


X 


X 


3* Difference of Sets 




X 


4. Subtracting #^s 


X 


X 


5. Adding #*s 6-10 


X 


X 


6. Tens and ones 




X 


7« Number Sentenites 




X 


8t Geometry: 

a. Measurement 

b. Construction 




* 

X 
X 



MATH SKILLS CHECK LIST (95% Accuracy) 



Name C. Norval 



Skill Presentation Entering Behaviours At 

Or<ler Behaviours Termination 



Book K: 

i 



I. Bigger • Smaller 


X 


v 

A 


2. #*s to two 


X 




3* Larger • Shorter 


X 


X 


4. #*s to three 


X 


X 


S. Matching Sh24>es 


X 


X 


t'% to five 


X 


X 


7« Countif^ Pennies 


X 


X 


Boole 1: 


I. Union of Sets 




X 


2. Adding #'s 1-5 




X 


3. Difference of Sets 




X 


Subtracting #*$ 




X 


5. Adding |*s 6-10 




X 


6t Tens and ones 




X 


7* Nwriier Sentences 




X 


8. SMmetry: 

a. Measurement 
b« Construction 




X 
X 



Hath Skills Checklist (95% Accuracy) 




Coe N. 


Sk i 1 1 Prfisen tat i nn 
Order 


CRvering 
Behaviours 


oanaviours At 
Termination 


1 * Addition of 




X 


A* VI 1 1 d 6IIVC Wl 96 




X 


Of #•$ 




X 


4. Add t Sub 




X 


5. Tens ( Ones 




X 


6. I*s 11 to 19 


7. 100*s 10*s and ones 




X 


8. Less than 




X 


9. Regroup! no Addition 




X 


10 Geometry 




X 


11. Regrouping in Sub 




X 


12« fractions 


13 « Equations 




X 



\k. Multiplication 



15. Area 



16. Word Problems 



f 

( 



MATH SKIUS CHECK LIST (95^ Accuracy) 




Name Gary W. 


Skill Presentation 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


Book K: 


i. Bigger - Smaller 


y 

n 


X 


2. I's to two 


X 


X 


3. Larger - Shorter 


X 


X 


4. #'s to three 


X 


X 


5. Matching Shapes 


X 


X 


6. I's to five 


X 


X 


7. Counting Pennies 


X 


X 


Book 1: 




% 


1. Unimi of Sets 


X 


X 


2. Adding #'s 1-5 


X 


X 


3. Difference of Sets 




X 


Subtracting |*s 


X 


X 



5. Adding |'s 6-10 



Ntth Skit It Checkllik (9St Aecurdcy) tery W. 



Order 


Entering 
BiAaviourt 




bobavlours At 
Tomln«tton 




1. Addition of #•$ 


X 




X 




2. Dtfforwiee of Sots 


X 




X 




3. Subtraction 
of 






X 




IL A ilk A 

4. AM ft Sub 






X 




>• Tms S Ontf 






X 




^ ill A 1 1 ft A 

D. f*f II to 19 






X 




7o lOO'f iO*s and ohm 






X 




Q* Lett than 






X 


-* 


9f nagrouplng In Addition 






X 




I0« GaoMtry 


X 




X 




11 • nagrouplng In Sub 






X 




12. FraetloM 






X 




1). E<|(MtlOflf 






X 




Nuttlplieotion 






X 




15. Aroo 






X 





16. W9rd Probliiw 

X 



MATH SKIUS CHECK LIST Accuracy) 




Name 


Skill Prcfentatlon 
Order 


Entering 
Behaviours 


Miav lours At 
Termination 


Book K: 


• • Digs^r • Smilef 


X 


X 


2* f 5 to two 


X 


X 


3* Largor - Shorter 


X 


X 


^« f s CO tfiroe 


X 


X 


>• natcning Shapes 


X 


X 


0. f * to flw 


X 


X 


/• uMifiting Pmnies 


X 


X 


Book 1 : 




X 


1. Union of Sets 


X 


X 


Z* Moing f 1*5 


X 


X 


3* Offfermca of Sets 


X 


X 


• 

k. Subtracting I't 


X 


X 


5. Adding |'t 6-10 


X 


X 


6. Tent and onM 


X 


X 


7. Number Santencei 




X 


8. (iMMiatry; 

a. Naaturamant 

b. Construction 


X 
X 


X 
X 



ERIC 



!» Skin* Checklist ($5% Accuracy) 




it. Hottley 


dKi 1 1 rr€S0iitdCion 
Order 


Entering 
Behaviours 


Behaviours At 
Termination 


■ « Aoai^icm Of If s 


X 


X 


^0 uiTTvrenccs or sets 


X 


X 


^ • aiivirovc i on 
of #•$ 




X 


4. Add e Sub 




X 


5' Tens 6 Ones 


X 


X 


6. I's 11 to 19 




X 


7. lOO's 10's and ones 




X 


8. Less than 




X 


9. Regrouping in Addition 




X 


10. Geometry 




X 


11. Itegrouping in Sub 




X 


12. fractions 


• 


X 


13. Equations 




X 


U. Hultiplication 




X 


15* Area 




X 


16. Word Problems 




X 



f 



MOm SNEH SMPUS 



ERIC 



c 
o 



<0 
N 

c 

ID 



O 

e 

m 
o 

< 



5 

*> 

(D 
> 
O 



1^ 



I 



s 

I 
I 

o 

s. 



I 



e 

8 



fl 



C > I 

3 — * 
4- 3 



i 

o 

«»• 
e 

i 




£^ "Z^ c— accfJS 



» W 19 



8 



4B 



4- 

8 



e 

I 



t- 01 

228 

ode 0. 



If 



— • 



I 



Is 



£ 



£ 



I. u 



£S-£ 



«0 4A|9 • 



I 

4- 

c 



I 

JR 
4" 

*5 



£ 



u 

C/l Q. 



I 

II 



II 

eg 

15 
52 



I. 

? 



d» 

> 



51 

8 



«l 



4* 0 



• 0 — 

C ^ Oj3 
« U 

O -D 4- C 
7 C 3 

-O *- T? W 



• 4- 



o 

c 



i. 



t- • c 

® u 0 

® «- 

X tf> d> c 

c i o 

0) 



jr» o *o 
o ' ^ 

J U 4- 

O ^ c 
-C 4- 



3 > O 

o i c 



O £ 
IB 

<A 
9 



c 

5 



C 

u 

e 



o 
a. 



8 0)4- 
H-l 8 

8^ 



0) 



i m lA 

0 4-1 

u c 

^8 



(A 
e 

I 



il! 



ERiq 



8 

□□□ 

oc or 
— uj o 

3 Z > 

C <c O 



2 

U? 

to 



• 5i 

o o 



<0 10 <0 
•t — 

c u ^ 

o 



I- 

OL 

□□□ 

< z c 



Ui 



< 



o 



If t 

Ui 

> 

9 



O 



NT 


Pit 1 

CI T 1 


UI 














ll 














< 









C 

JO 

o -c 



u 



p 



a-f- 



! 

0) 

4- 

a s 

c ^ 

o c 



Q» — jC 



p 4- 

H 6 



C) i § 
o *- ^ 

4- 

"O c 
.u — 

O "O • 
U C 4- 

poo 
u c ;n 

-C 4- 

c o 
d) > 

h-_G <P 



0 
O 

> • -o 

o © <o 

i X 

o u o 
— ^ in 

Q. 

c u 

X — 
3S O C 

o o a> 
4. TV 

o c 4- 
^ — to 



4- c 

« ?*> t 

4- 'J Ql£ 

4-3 U 

O O M <0 

— 4- O © 



-ex 



c 



X O 
4- ^ 

O C 
I 
I 

u 



UJ 



c a— u 
to u o 
£ ^ 4- 

CO 4- 

— to — o 
o — 

O U) (0 
4* ^ 4- O 

w c 
^ 0 n 

J£ 4- £ 
U 4" CO tf^ 



0 



c 

o 



u 

<!> 
U 

0.4- 

- © 

It ifi 
C 

t/» O o 

^ a D 
© 3 

o ^ g 



in 



4- 



f 

8 '-^ 

<A 4* 
© 

J 



— in 

mm H 

© § 

3 ^ 



^0 0. 

© <n 0 
UJ <p C 



01 



c 



o 

4- 

O 



in 
c 



C 



c 



J 

ERIC 



s 



— uj o 
o cn 



c 



< X o 



CO 

a: 

z 
< 



Ul 



CD 



(0 



Ul 



Ul 

o 
o 



z 

UJ 
UJ 

> 

i 



z 

Ul 
Q 
Ul 

o 

UJ Ul 

I- 
z 
< 







O 




O 








(D — 








> 
















sz c 




at — 








>. 




CD 






5 



0) jC 



c 

O 

o 



> 



(0 
(0 -C 

Q) - 
V) O 

10.3 



(A (A 

(0 (0 
Q 

C 
W (0 



«5 JT 
3 U 

cr 

0) 0) 

c 

m o 



o 

C 

o 



x: 

4- C 

U O 

U C 
O 

y — 

c a 

O 0) 



— c 
£ — 
'J o 
d 

C 0) 

a. o 
x: %n 

(A — 

© :3 
c o* 
O © 



^A 
T> 
C 

O 

(0 
CO 



T? -I- 

C 0) 

-: jC 
£ tn 



c 



0 > 

•F o 

o m 

I 

I 

o 



C7) 

(1) 

— U 

— (0 

*5 (A 
0) 0) 

a 3 

(0 

0) (A 



> 
3 

H 

<A — 

•a 0 

0) X 
(0 (0 

a> 0) 

<A h- 



(A 

3 O 

3 «3 

E £ 



(0 

^ c 

L (1) 

0) u 
> -a 



a. 

3 

O • 

(A 



C 

8 

U 



4- > 



C 
0) 

• x: 

(0 2 



4- 0) 

3 (0 
0-4- 



0) 

> 
O 

a 



c 
o 

OL 
(A 

(t? 0) 
— 3 1- 



3 

*> m 

— n 

C 0) 

— > 



L. 

— o 

*— L 
2 0) 

d) c 

JZ (0 
(0 4- 
I- 0) 

u 
♦ o 



c 

3 

c 
o 

4- 

J) 

0) — 



CD 



I 

o 



I 



o c t- 

0 C 4- 



c 

— -o 

♦ Q) 4- 

— O O 

O) 3—1- 

!D >. g — 

^ — TO • 

0) i tA 

O 4-- (A >. c 

(A (0 — o 

C — C O) 

O3B0TJC3<04- 

a. a n) — g 3 ^ 
0) E ^ — -a a> 
0) ^ 0) i 3 



O 
4- 



C 
O 



u 

3 
C 



Q. 
3 

£ 

CD 



OH 
c 



ERIC 



LL_L 










1 

4 










1 

J — 




















i , 


! 










1 












i 




! i ^ ■ 


5 

i^. ... 




i — 


i 








: i' i 


— i I 


i 1 , : i 
: i : 1 ; 


^ 


1 

1 j 






« 


•li i ; i ; ! . > 1 ■ 

11' i . 1 ; ; ' 1 i ! 


1 


f 

! i 




< 


i ! > 


4 > ; j r ~T ! f : j ... 

■ t . • ' I '' '■ 

« ■ i ! ' ! i •■ 
» 1 > II.....,- \ ■ ' . ,• _ .. < ? 1 




! 
1 


r 1 




i ! ' i • I \ 

I I I I ^ : \ 


1 






t 


f 4 

H 


— 1 — 


:• * 1 ' ' i 

1 : ; i ^ 1 : ! 










1 1 

1 — i. 


i i i i i i i ' ; 

! i 1 : i M 1 ^ i i 

— ' 3 1 1 ^ i L L. 1 ? 1 










f ^ 

1 "1 


I ! 1 • i : ' ^ i ^ 
1 * t - ' ^ J * • " 

! ! . i 1 ' • 1 ! i 


i 


t 

I 
1 








1 ! : ! i i . i J . 

1 s ? ! i .: i 1 " ! ! 


1 

4 
1 








'? « » ! 

! It ' 
■ j 1 


1 ! i I ; i ; . { • - 

M . ; i i i i ! 


I 
1 








i — !■ 




1 M ! M i i i 1 
' — \ — 1 — ! — ^ — i — 1 — — ! — i — , 


'< 

I 








■ ^ 

i ^ 




1 i ! M M M 














1 \ ! 




1 ! 1 1 ' 
1 i \ i j 










H 




1 5 




{I'll 

1 : i 


I 

i 








i •! P ♦ ^ 

; 1' 


1 ! M 1 i : 


1 ^ 

1 


i 

t 

f 






1 

, f 
— U 


). • w 


1 ! i i 1 
— i — 1 — 1 — i i 


\ ? 


i 

! 


1 

I 






l| 




i ' i j 

J.. i ! 


1 

1 

1 


1 

t 








4 












\ i 1 






1 
1 
















'] 


^ 1 


1 


1 


i 1 
























• 




1 11 








-T3 














ERIC 





1(0 d ^ CJ O « 10 1 




— r 

i 


0 ^ > ^ ^cuo 






i 


■• : : — ' '"■ 


1 
\ 
« 




1 




— ^ 

i 




■ !• 

J 


— - lO c 




; -H M > 0 CO :£ F 




i 5^ -XT 5 c 0 — <a) 


i 

1 

1 

— i- 




— r 



nor 



4- ^ 



«0 



t-3 E ~o 



4 10] «^ iQ^ 



i 




4 

o 

01 



m 
o 



ac cc 
UJ o 
Quo </> 
3 < — 

a. z > 



c 



< X O 



Hi 



to 
a: 

UJ 

< 



Ui 
UJ </> 
CO 



LU 
LU 



^ > 



o 



p 



UI 

u 

X 



o 



UJ 

Ui 
o 

UJ 

z 
< 



• 5 
c a> o 
o • X 



C .2 JC 

« Z 2 

^ o 



ID 
O 



XT 

4) 4) 

C 

tf) o 



u o 
O 

U (A 

4) O 
4> 

O 4J 



u 



4) 

*J C 

u o 

4) 

>- O 
1- ^ 

o 

u — 
m 

4) 3 

c cr 

O 4) 



Q. 4J 

— C 

jr — 
u o 

Q. 
C 4) 

10 

4) 3 

c cr 

O 4) 



c 



-8^ 



o 
o ^ 

4) 



c 

O 

u> 

>• 

m 



t tf) 

»- 3 
0) ^ 

*J 3 
4) £ 
-O 

m 

o 

4) +J 

I- 0) ii 

U c 4) 
O *- JC 



c 



o m 
I 
i 

u 
O 
1- 
1- 



J 



4) 

o 5 



2i 

(0 

4J * 

C 4) 

4> • 



ft: 
o 



4) 

— W 

u c 

• 4) 

U 3 

10 4J 

4) (A 

C 
4) 
• J= 

m 2 



3 

4) 

4) ^ 
4J U 

m m 

4) 4) 



3 4) 

i i 



4J 4) 

3 m 
cr4J 



^ *i 
^ c 

4) U 
> T3 

-D x: 
> 

u c 
a. m 



3 

O * 
>- <n 
cn 4) 

</> 

>- c 
o o 
a 

— 

m 4) 

3 i- 

> m 

C 4) 
— > 



c 

3 
O 

u 

1- 

— o 

^ 1. 
1- 

^ 4) 

»- XJ 
4) C 

m 

u 

4) U 
H- 4) 
1- 
U 

A O 



i- 
41 

C U 

3 m 

O 4) 

u 

c i 
o — 

tn 

4) — 

§-i 

a 

<n 4) 
4) J= 
»- </> 



t 

O I 
u 

Ui C 
C I- «— -n 
— i) 41 

C M- — -O U 

*— m — 41 

O) 3 i- 

g 6 — — 
^ ^ -0 * 

4) <M 3 (A 

<U 4-f (/) >. c 

tfl <0 .-P o 

C — €7)^ — — 

O "O C 3 to 

Q- g — e 3 trt 

(/» e -o x> 4) 















— m 














< 




41 












C 






in m 


1 




3 












a 


u 






m 


'♦ • 


41 




4) 








*j J 




m 




o 


o 









c 
o 



u 

3 
L. 

(A 
C 



cu 

3 

e 



Ol 

c 

XJ 

4) 

OC 



ERLC 



— cr V' 



o 
a 



< 2: o 

a: 
< 



< 

















If 














< 










> 






























f.; 








1 








>• 














./ 1- 










'.J 




> 










































* 




r- 


- 




















































..1 


y 


















• 




''' 
















<— 






t 




iXi 






















J 












^ J 
















' 


























LU 










- 












! 


























* 


! 
X 






































'V 








_ ■ " > 






1 
























I 




a: 








































- 






1 


i 
1 








- 


V 














1 
1 
} 
1 




—J* 






















































*' 




















i 
































_ I. 














































1 






- 




















1 

i 


t 








-' 
















1 




c. 






















• 
















































































» 












* 












1 










V 




*' 


























*** 




•- 






t' 












- * 


c 
























- 














* 














-I 




















- 










"J '' 








1 








— 










,* 








1 


1 


































* 








r\_ 
























*-* 




y 
























-T 








j 


^■ 




^' 












/ 










CSf 
























* 


















<^ <-■ 










5-3 














c 












?• 






..J 


















V 




















































• 


J* 




































— 








































j 


i 














„■* 












I 




** 

•* 




















i 


























1 


J 
























1 


1 
























1 


1 








• 


























1.- 
















t 




t 












" 0 










1 






.•V 










0> 






























































,^ 




































































^ rj 










i 


























i 












'.J 




>- 










1 






1 


n 






i: a- 










1 


























1 


























* 


i 


















































f 


























! 
* 


























! 
















'J 






























































i 




y. 


































«/ 


















a. 
























^• 








.J 
















I 


0 


r 






















> 


















) 








1 
















































































0 


























-J 



























ERIC 



M 


JLT 




i OA 


TiOi 


\ 1 


1. 


1 ' ^ 

3 AT 


LU IJJ 












7 


5 


8 


8 




- 


7 


8 


1 


7 


7 


I 




1 




y 1 

A 1 






y A 


A_Z 


V /i 


Xj_ 




x^ 


x^ 


XjJ 


xy 


Xlj 


<? 


7 




1:;: 






C7 


P, 


Q 
0 


6 


^7 


-7 

/ 


6 




x8 


A w 


A %J 


y 7 


Y 7 
A / 


V 

A 


Y 0 


X_c 


x6 


x_z 


V P 

X 0^ 


V // 

Xz. 




Xjf 






c 




6 


<? 








7 






8 




V n 






\y '7 






X_/ 


XU 




XJ_ 


XV, 


xU 


x3 


XO 


a 

/ 


■7 
/ 




IL 


8 


7 


0 


u 


r 


z 


7 








xO 


x3 


x5 


yO 


X y 


x^' 


xO 


x8 


^\ 

x J 


xO 

A \J 


y A 

A> u 


x^ 

A V 


A 


y 


7 


8 


<? 


6 


7 


8 


7 


8 






Z 


—J, 

/ 




P. 


x6 


x5 


xO 




xV 


x2 


xO 




xl 


x3 


xO 


xi 


x6 


x7 


8 








6 






1 








7 






xi 


x7 


x2 


x5 


xi 


x2 




x6 


x2 


xi 


x2 


xl 


xi 


x3 




7 






'/ 


6 


8 




6 


♦ 


7 


// 




// 


x3 


xO 


><2 


x6 


xj. 


x2 


xO 


xl 


xi 


xO 


x2 


x3 


x8 


x2 



ERIC 



/v^ULTIPLtCATION l\iAME 




57^23^567? 5 876 
x2 x5 x3 xj_ x7 x2 x^ xO x6 x2 xO x^ x3 x2 

86867 7 3 8 7583^8 
xO x3 xO xO x7 x2 xO xV xi x7 x2 xO x3 

7^^ 5 76763^^365 
x6 x3 x^ xO xl x2 X 5 x^ xi x8 xO x2 xO x^ 

^7?25?2^ 5 327//8 
x8 x? xj. xi x6 XO x8 x7 xS x^ x5 xi x3 

532 6 726^^2738^ 
x7 xi x8 xi xi x8 x8 x6 x5 xi x^ xi x2 x7 

358678 3 7777573 
x8 x6 xi xi xi x7 xi x5 xl x8 x5 x8 xi xi 

8668738^//56V76 
x3 x8 xi xi x6 x7 x5 xi x7 xi xi x7 x8 x7 



MULTIPLICmTICN 



0>JE 



■9 706'/'?7«C267'/? 
xO xO x6 x2 xO xO x2 xO x6 x6 x? xO x3 xO 



0 

w w 



6 'Z 9 ¥ 0 



z 



I 



xS x5 xO x^'/ X? X? xO xl x3 x2 x6 xO xl x3 



o -5 



b \ 1 3 



I Q 



2 5 2 



x2 xl x8 x3 xj_ xO x2 x7 x3 x6 xi xO 



0 V 



7 ^ 



^/ 2 7 6 2 3 0 0 5 6 



xO xii xl x,0 x3 x2 x2 xl x3 xl x? x^ x± x2. 



5 6 2 6 3 C 8 6 3 « 6 7 i 
xO xO x2 xl X? x2 xl xO x3 x5 xO x2 x^ x5 



6 0 0 1 

xO xO X I xO x 



i 2 0 



0 2 



1 



xO x2 xO x3 xl x2 x2 xl x3 



V005I'=^23 6 0I52'/ 
xO x*/ x5 xG xV xl x3 x2 xO x6 x5 xl x£/ x2 



307I62'53V8 0I 
x3 x7 xO x6 xl x5 x2 x'/ x3 xO x8 x7 



7 2 
X I x6 



MULTIPLICATION 



DATE 

f0V87?3256'/873 
xl x3 x3 xi x2 xO x5 x5 xV x3 x3 xO x2 x5 

1 

i 56'762'/53275'/83 
x2 x2 xO x2 x£ x5 xl x2 x7 xO x3 xO x5 

570326'? '/ 2606'/5 
x3 xO x3 x2 x6 x2 xO- x2 x6 xO x8 xO x5 xO 

027 V 3 2'/ 7305836 
x2 x7 x2 x3 x2 xV x3 xO xO x? x3 xO x6 xO 

806'/7'/ 3 3753200 
xO xl x2 x2 x2 x3 xO x5 x2 x2 x2 xO xl xO 

0830 5 2'/0368620 
xl xO xf: xl x7 x3 x3 x6. x2 xO x3 xV x£ 

<7 8. '/76385'/02'/35 
xO X.I. x3 xO x3 x5 xO xV xO x2 xl x3 x5 xO 

635'/0? 182736^5 
x2 x5 x3 xli xl xO x3 xi x7 x2 x6 x3 x5 xV 



APPENDIX C 
SAMPLE GRAPHS—STUDENT PERFORMANCE 



1 

ERIC 



0) 

8 



b 

a 



CL 
X 
U3 



□ □□ 



— Ui o 

— CD CO 

cx< — 

2: > 
Ol < o 
2: < 



0) 



0 

CL 
C 

□□□ 

< 2 C 



i 

































































6 
























1 ^ 




























1 ^ 






















c 


t- 








« -- 






































* J 










i! 










0 








c 


'A 




4- 
































UJ ] 


1 
















0 




j% 




iLi KO 
















<.» 












CD 


0 






















roi 


i- * 


r> 




















r 




D • 


CO 


CL 


u 






c 
















C C 
















0 


c 








w 


>- E 



< 



o 
>- 
o 



2: 

UJ 

O 



UJ 

o 

UJ 
O 
UJ 

< 



g 



I— 



^ i 
2 8 

n ^ 

UJ "D 



C O 



-O O 
c ^ 



o 
o 

CO — 



c 






0 






a 








0 


























c 






0 








a 












CL 




iP. 



0 



c 

O -c: 0 



1- X. -- 

O ^ " 

o * , 



o c 



c 



o - 



> 



01 



to 

O > 



a 4- 

1^- C 



— CO 



I i ^ ^ 

. x: 



L. 

- O 



C X^J 

C 



i- O O 





13 


























> 






























C 


















C 






4* 






c» 


IT' 


^/ 






0 




0 


a> 






0 




cr 


Ci 


X5 














1 


3 














G 


c 


b 




0 


J- 



c 

O 

o > 

UJ I (0 



1; 



(0 



o 



«3 O 



2 — 4* c> u 

5f C ~ .- 



O O "3 ^ 



o 



X. 

x> 

I'D C <y 

^ trs fD o lo 

o * — 

f'/^ I- 0 

t; C 'D 

U 3: "O 
O ^ i/> C * 

i:: O o c <D 1. 



1) 



to 

CO I c 

c > ^ 

O o jc: j:; u 

i:., t'l *") (O ST 

UJ 



O 
> 



3 

o • 

c 
Q 
x: 
3E ^ 



u a4- o 

> a; o 1/1 

0) ^ x: o 

4- u 





c; 
x: 
u 

o o 



5 <D 
<u x: 
I— 

T3 ♦ 

C O 

<u o 
x: tt> 
cx 

a? 
>x: 

4" 



'0 

x: 



05 



o 



o 



'A 

c 

o 
c. 

O 



— 3) O 



. o 

0 

36 u (y c 



i/l c ^ 

■° v; .5 8 

T, >2 



e c -j: 

c <xj u > 

> o ? r 

iw — Q AT. 

(Ti— ^ i» o. 

O — Xi CD 

>. 3 O C 

G.- is O 



O 

o 



0 



1000 

600 



i 



lOOi 
60 

K) 

5 



I 

jB 

.1 
JOB 

.OI-! 



soo 

1 

p 



CAUNOAft WEEKS 



GRAPH 17- 



4 

■4 I t 



8 

< 1^ 1 , > tr 



12 



16 



20 



.0QI4 

o-« 




50O 

5 /"BK 
' lA 



BKl 





4^ AM 



O 10 20 30 40 50 60 76 80 90 ICQ IIO 120 130 I40 



H xMux 

TMINM ADVISER MANAGER ' 



O'Uary, Blumhoff SUCCESSIVE CALENDAR DAYS Robert R. 



*»irouc€ 



Write Letters 



Graphs 17-1 and 12-1 (Sullivan) Are examples of situation in which an increase 
error response trend is reversed by lowering the teacher contact code. 
More frequent teacher contacts not only allows for additional teaching, 
but also tends to curtail student guessing and carelessness. 
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Graphs I7-I and 12-1 (Sullivan; Are examples of situation in which an in- 
creasing error response trend is reversed by lowering the teacher 
contact code. More frequent teacher contacts not only allows for 
additional teaching, but also tends to curtail student guessing 
and carelessness. 
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Graph 05-1^ Is a students Sullivan Programmed Reading one-minute Say Word graph. 
When a teacher makes decisions concerning the students Write Letter 
response rates, he should first consult this graph so that he can deter- 
mine the students ability to read (sighfword recognition) the material. 
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Graph 19*'2 (Sullivan) illustrates the implementation of a contingency arrange- 
ment in a reading program of points and models (reinforcement). Again* 
the result is an increase in positive responses with an accompanying error 
response decrease. 
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Graphs 19-29 and 2]^S (SRA Reading Lab 1A) Illustrate that a student who is 
working in the individualized environment of the precision teaching 
program will (if properly placed, and managed) gravitate to a pattern 
of errorless responses. 
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raphs 19-25 and (SRA Readinq Lao lAj Illustrate that a student who is work- 

ing In the individualized environment of the precision teaching program will 
(if properly placed, and mof-^aged) oravirate to a pattern of errorless responses. 
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Graphs 01-6, and 03-7 Suopes Math illustrate two students who worked for a long 
period of time without an extrinsic reinforcement system in effect* 
The day to day fluctuation in correct rate is probably more a function 
of inconsistentcy in material di^^ficu^ty than student motivation. 
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Graphs 01-6, and 03-7 Suppes Math illustrate two students who worked for a long 
I period of time without an exf^insic '-einfo*'ce'nent system in effect. 

I The^day to day ^fluctuation in correct *'ale i$ probably more a function 

; of inconsistentcy in material difficulty than student motivation. 
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Graph 05*7 is 



a representative example of the resulting effects of a contingency 
instituded phase change. On 10-12-70, following a 2 week trend of rising 
errors and falling corrects, the student was out on points. For the next 
students corrects stabilized, and the errors began to 



two weeks the 
approach zero. 



On 10-26-70 the student was allowed the opportunity to buy models. Place- 
ment of this added contingency (called an ''Add On") resulted in a steady 
increase in correct responses and a decrease in error responses to the 
zero level. It is noteworthy to observe that these trends occured con- 
current with an increase in material difficulty (placement in book 2 on 
11-10-70). 
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Graph 03-2 Depicts a situation in which a reinforcenent contingency did not effect 
correct and error rates. In such a situation one of two possibilities is 
occurring. Either the reinforcement is not a reinforcement to that child, 
or the material is too difficult. Usually if the student is making responses 
then it is a material problem, and more teaching must take place. On 11-30-70 
the teacher contact code was changing from every five problems to every two 
problems. The next two weeks show a resulting decrease in errors to zero 
and a steady increase in correct responses. 
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;Graph ]^-3 Illustrates a situation in which a tftid^cr^itr code change on ;-"~/0 did not 

subsequeot'y sign? f icant «y efttct correct and error rates w^!Ch hac also been 
f resistant to a positive reinforcepent cont • ngencv Tt^erefore, on 

^/!5/70 a negative contingency was instituted;, Beginning on t^at date 
recess wou«d cost 2C points. If the stuoent didn't earn enough points 
to buy recess then she wou^d have to work rnath during the recess 
period, ^s a result of this contingency tho* «;iudcnt*s error responses 
fluctuated arourd ^e^o dna her correct responses -^huw a positive trend. 
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Graphs 1^-1 through U-7 illustrate typical student performance in DISTAR 
Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the "floating floor'^ v^hereas the 
other three measurements were one-minute samples. 



GRAPH 14-1 



CALENDAR WEEKS 



KXX> 

800 

100 

60 



8 



i2 



16 



20 



3 

i 



> 
O 



10 

5 

I 
3 

A 

.06 

.01 
.000 



.OQlJ 

0"» 



i 

0 

Error Cont 



11:30 

add 

a,h,a 



r.l 



th.c.d. 



/add 



A 



'add 



add. 



add 
5,v,p 



i 



O lO 20 30 40 50 60 70 80 90 lOO HO I20 I30 I40 

Maddux oaeary,Blutnhcf f SUCCESSIVE CALENDAR DAYS Juani ta Say Sounds 



MAMGCI) 



PNOTCCt 



AGC LAKl MOVCMCNT 



Graphs 14-1 through 14-7 illustrate typical student performance in DISTAR 
Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the '^floating floor" whereas the 
other three measurements were one-minute samples. 
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Graphs through illustrate typical student performance in DISTAR 

Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the "floating floor'* whereas the 
other three measurements were one-minute samples. 
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Graphs through 14-7 illustrate typical student performance in DISTAR 

Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the "floating floor" whereas the 
other three measurements were one-minute samples. 
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Graphs U-l through l4-7 illustrate typical student performance fn OlSTAR 
Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the "floating floor'' whereas the 
other three measurements were one-minute samples. 



GRAPH 14-7 



WOO 

600 

100 

60 



Ji! 

3 



12 



> 



10 

6 
I 

j06 

.OI-( 
.006 



.OOi 

I- 
O 



CALENDAR WEEKS 

8 



4 



I,k, 



Jfaddux 




16 



20 



lO 20 30 40 SO 60 70 SO 90 lOO ' IIO I20 I30 I40 



Soli 



SUCCESSIVE CALENDAR DAYS 



»« 

to 

•4 



MANAGE P 



Ooug B, 



•I 
"i 



t 

> 

r 

•< 

o 



Write Letter", j 

MOVCMCNf^ § 



Graphs 1^-1 through \k-7 illustrate typical student oerformance in OlSTAR 
Group say-sounds, say letter, individual say-sounds, and write 
letters. Group say-sounds has the "floating floor*' whereas the 
other three measurements were one-Tinute samples. 
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